-- Logs begin at Fri 2022-10-28 18:29:24 UTC, end at Fri 2022-10-28 19:19:49 UTC. -- Oct 28 18:57:30.041561 dv-cinder-862365-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 18:57:30.051217 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 18:57:30.052994 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 18:57:30 2022] *** Oct 28 18:57:30.052994 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 18:57:30.052994 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 18:57:30.052994 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: nodename: dv-cinder-862365-1-iscsi Oct 28 18:57:30.052994 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: machine: x86_64 Oct 28 18:57:30.052994 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: clock source: unix Oct 28 18:57:30.052994 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: pcre jit disabled Oct 28 18:57:30.052994 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: detected number of CPU cores: 4 Oct 28 18:57:30.052994 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: current working directory: / Oct 28 18:57:30.052994 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: detected binary path: /usr/bin/uwsgi-core Oct 28 18:57:30.052994 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: your processes number limit is 47680 Oct 28 18:57:30.052994 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: your memory page size is 4096 bytes Oct 28 18:57:30.052994 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: detected max file descriptor number: 2048 Oct 28 18:57:30.052994 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: lock engine: pthread robust mutexes Oct 28 18:57:30.052994 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: thunder lock: enabled Oct 28 18:57:30.053839 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 18:57:30.053839 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 18:57:30.092567 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: Python main interpreter initialized at 0x5638716459c0 Oct 28 18:57:30.092567 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: python threads support enabled Oct 28 18:57:30.092567 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: your server socket listen backlog is limited to 100 connections Oct 28 18:57:30.092567 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: your mercy for graceful operations on workers is 90 seconds Oct 28 18:57:30.092988 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 18:57:30.092988 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: *** Operational MODE: preforking *** Oct 28 18:57:30.093225 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: *** uWSGI is running in multiple interpreter mode *** Oct 28 18:57:30.093225 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: spawned uWSGI master process (pid: 103831) Oct 28 18:57:30.093402 dv-cinder-862365-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 28 18:57:30.095180 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: spawned uWSGI worker 1 (pid: 103832, cores: 1) Oct 28 18:57:30.095180 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: spawned uWSGI worker 2 (pid: 103833, cores: 1) Oct 28 18:57:30.095180 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 18:57:30.753218 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 18:57:30.755670 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 18:57:31.830974 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 18:57:31.830974 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: from cryptography.utils import int_from_bytes Oct 28 18:57:31.831525 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 18:57:31.831525 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: from cryptography.utils import int_from_bytes Oct 28 18:57:31.831977 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 18:57:31.831977 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: from cryptography.utils import int_from_bytes Oct 28 18:57:31.832117 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 18:57:31.832117 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: from cryptography.utils import int_from_bytes Oct 28 18:57:34.351562 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 18:57:34.352129 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 18:57:34.352225 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 18:57:34.352558 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 18:57:34.352628 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 18:57:34.352693 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 18:57:34.352884 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 18:57:34.352992 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 18:57:34.353246 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 18:57:34.353332 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.353514 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 18:57:34.353622 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.353909 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.354017 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.354238 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.354324 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.354565 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.354651 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.354877 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.354969 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.355231 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.355316 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.355545 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.355643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.355870 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.355953 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.356138 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.356231 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.356459 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.356555 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.356750 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.356834 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862365-1-iscsi {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.357070 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.357154 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.357394 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.357492 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862365-1-iscsi {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.357716 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.357862 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.358035 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.358134 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.358343 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.358433 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.358660 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.358766 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.358967 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.359078 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.359326 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.359514 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.359622 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.359945 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.360145 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.360316 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.360464 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.360599 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.360749 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.360896 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.361051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.361180 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.361393 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.361484 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.361712 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.361796 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.362027 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.362124 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.362352 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.362437 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.362664 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.362748 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.362999 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.363121 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862365-1-iscsi {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.363326 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.363428 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.363733 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862365-1-iscsi {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.363829 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.364050 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.364146 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.364393 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.364506 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.364710 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.364808 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.365118 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.365212 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.365430 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.365514 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.365745 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.365831 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.366053 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.366180 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.366383 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.366467 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.366696 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.366791 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.367033 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.367131 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.367361 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.367453 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.367670 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.367769 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.367983 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.368068 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.368286 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.368370 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.368600 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.368693 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.368903 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.368987 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.369211 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.369295 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.369463 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.369559 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.369773 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.369868 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.370047 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.370130 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.370360 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.370445 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.370685 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.370769 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.370957 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.371058 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.371237 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.371352 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.371559 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.371653 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.371847 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.371945 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.372172 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.372260 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.372482 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.372566 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.372793 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.372877 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.373098 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.373189 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.373409 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.373494 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.373717 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.373802 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.374033 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.374161 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.374329 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.374430 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.374642 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.374729 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.374954 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.375101 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.375302 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.375387 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.375611 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.375704 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.375933 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.376018 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.376246 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.376329 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.376571 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.376657 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.376881 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.376966 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.377215 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.377312 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.377530 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.377615 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.377840 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.377931 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.378165 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.378260 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.378477 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.378572 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.378792 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.378876 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.379131 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.379233 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.379441 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.379538 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.379773 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.379859 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.380091 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.380188 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.380414 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.380540 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.380672 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.380767 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.380983 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.381069 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.381280 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.381363 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.381590 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.381675 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.381897 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.381989 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.382210 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.382294 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.382514 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.382604 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.382818 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.382902 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.383153 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.383238 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.383462 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.383546 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.383771 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.383862 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.384079 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.384162 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.384389 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.384482 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.384695 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.384790 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.385002 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.385085 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.385309 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.385409 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.385614 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.385697 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.385919 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.386003 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.386225 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.386317 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.386535 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.386622 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.386843 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.386927 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.387180 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.387285 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.387493 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.387580 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.387801 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.387944 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.388113 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.388198 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.388421 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.388505 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.388733 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.388817 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.389041 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.389133 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.389351 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.389435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.389663 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.389755 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.389971 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.390065 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.390301 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.390429 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.390597 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.390682 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.390908 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.391019 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.391239 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.391333 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.391553 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.391639 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.391864 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.391961 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.392174 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.392544 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.392748 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.392833 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.393057 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.393141 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.393362 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.393446 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.393670 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.393762 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.393981 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.394074 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.394291 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.394429 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.394601 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.394686 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.394908 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.395036 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.395259 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.395345 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.396122 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.396212 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.396438 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.396574 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.396749 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.396835 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.397062 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.397156 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.397386 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.397472 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.397701 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.397785 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.398031 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:57:34.398125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.398374 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.398459 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.398689 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.398772 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.399051 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.399157 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.399384 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.399468 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.399703 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.399792 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.400022 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.400109 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.400340 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.400426 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.400654 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.400737 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.400972 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.401056 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.401290 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.401382 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.401603 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.401688 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.401921 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.402014 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.402239 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.402349 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.402564 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.402651 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.402881 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.402966 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.403243 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.403329 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.403564 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.403650 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.403881 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.403967 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.404202 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.404287 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.404521 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.404606 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.404842 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.404926 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.405159 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.405253 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.405479 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.405564 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.405796 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.405889 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.406139 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.406223 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.406470 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.406564 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.406787 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.406882 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.407138 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.407239 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.407461 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.407556 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.407776 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.407861 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.408095 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.408188 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.408411 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.408506 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.408726 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.408810 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.409053 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.409137 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.409370 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.409464 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.409691 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.409775 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.410006 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.410090 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.410323 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.410409 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.410638 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.410730 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.410950 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.411664 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.411846 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.411934 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.412162 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.412247 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.412479 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.412565 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.412812 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.412897 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.413131 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.413215 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.413447 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.413531 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.413770 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.413856 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.414083 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.414176 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.414400 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.414493 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.414715 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.414801 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.415048 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.415137 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.415364 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.415459 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.415674 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.415765 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.415985 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.416075 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.416291 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.416384 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.416606 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.416691 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.416920 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.417008 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.417234 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.417330 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.417563 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.417647 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.417871 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.417955 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.418188 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.418283 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.418502 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.418585 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.418815 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.418900 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.419153 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.419241 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.419469 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.419554 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.419780 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.419869 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.420092 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.420178 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.420410 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.420494 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.420721 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.420812 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.421035 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.421123 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.421347 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.421438 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.421659 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.421743 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.421971 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.422057 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.422276 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.422360 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.422589 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.422701 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.422900 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.423003 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.423251 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.423337 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.423565 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.423666 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.423890 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.423974 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.424206 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.424296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.424519 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.424612 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.424836 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.424934 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.425153 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.425239 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.425471 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.425556 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.425802 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.425887 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.426109 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.426193 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.426438 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.426524 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.426774 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.426900 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.427113 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.427202 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.427424 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.427510 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.427730 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.427818 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.428036 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.428120 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.428345 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.428430 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.428650 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.428733 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.428955 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.429045 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.429261 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.429346 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.429565 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.429648 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.429868 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.429961 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.430179 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.430264 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.430488 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.430573 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.430792 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.430885 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.431129 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.431235 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.431439 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.431525 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.431742 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.431844 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.432055 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.432186 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.432407 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.432493 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.432725 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.432818 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.433052 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.433136 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.433381 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.433541 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.433697 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.433780 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.434003 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.434097 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.434321 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.434406 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.434637 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.434785 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.434949 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.435064 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.435288 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.435374 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.435600 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.435692 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.435915 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.435998 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.436236 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.436319 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.436548 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.436634 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.436870 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.436961 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.437185 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.437286 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.437511 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.437643 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.437821 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.438130 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.438216 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.438464 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.438551 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.438778 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.438865 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.439133 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.439221 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.439462 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.439549 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.439779 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.439871 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.440098 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.440183 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.440413 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.440500 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.440730 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.440815 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.441046 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.441181 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.441358 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.441443 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.441672 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.441756 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.441983 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.442076 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.442329 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.442419 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.442641 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.442725 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.443095 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.443304 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.443389 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.443617 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.443701 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.443925 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.444025 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.444246 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.444332 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.444568 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.444653 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.444882 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.444978 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.445200 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.445289 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.445517 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.445610 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.445844 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.445937 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.446157 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.446241 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.446467 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.446550 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.446781 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.446867 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.447118 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.447205 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.447429 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.447523 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.447744 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.447836 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.448058 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.448156 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.448369 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.448460 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.448681 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.448773 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.448987 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.449071 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.449302 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.449398 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.449612 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.449703 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.449921 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.450004 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.450224 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.450317 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.450539 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.450631 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.450844 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.450935 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.451180 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.451323 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.451498 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.451584 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.451820 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.451903 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.452132 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.452229 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.452439 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.452530 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.452766 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.452852 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.453073 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.453172 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.453382 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.453466 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.453691 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.453777 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.454002 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.454095 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.454308 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.454393 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.454620 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.454705 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.454931 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.455110 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.455278 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.455361 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.455603 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.455687 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.455911 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.455997 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.456226 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.456319 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.456542 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.456636 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.456856 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.457017 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.457182 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.457347 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.457500 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.457666 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.457851 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.458529 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.458660 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.458863 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.459027 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.459217 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.459304 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.459536 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.459621 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.459855 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.459940 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.460174 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.460260 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.460490 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.460574 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.460804 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.460902 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.461110 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.461197 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.461426 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.461510 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.461738 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.461830 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.462056 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.462306 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.462398 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.462644 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.462736 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.462966 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.463078 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.463317 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.463559 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.463678 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.463976 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.464074 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.464310 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.464404 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.464639 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.464724 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.464984 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.465069 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.465302 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.465399 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.465617 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.465709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.465925 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.466010 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.466235 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.466329 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.466549 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.466634 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.466859 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.466951 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.467196 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.467332 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.467506 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.467589 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.467818 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.467909 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.468125 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.468211 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.468431 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.468525 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.468739 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.468829 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.469044 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.469129 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.469351 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.469435 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.469657 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.469761 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.469964 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.470048 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.470271 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.470354 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.470588 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.470672 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.470899 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.471051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.471235 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.471320 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.471541 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.471624 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.471847 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.471932 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.472170 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.472260 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.472482 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.472576 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.472794 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.472880 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.473104 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.473188 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.473454 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.474143 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.474313 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.474399 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.474629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.474716 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.474963 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.475127 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.475299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.475388 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.475614 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.475701 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.475926 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.476012 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.476242 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.476327 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.476551 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.476635 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.476858 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.476943 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.477166 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.477250 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.477477 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.477561 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.477786 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.477878 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.478095 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.478180 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.478400 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.478483 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.478709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.478801 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.479041 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.479129 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.479356 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.479456 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.479667 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.479752 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.479974 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.480059 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.480279 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.480371 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.480589 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.480672 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.480899 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.480983 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.481205 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.481362 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.481509 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.481641 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.481815 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.481899 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.482124 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.482217 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.482432 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.482517 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.482739 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.482822 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.483071 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.483169 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.483389 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.483482 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.483694 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.483778 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.484007 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.484092 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.484327 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.484410 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.484640 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.484723 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.484949 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.485034 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.485254 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.485381 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.485571 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.485656 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.485882 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.485966 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.486186 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.486270 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.486491 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.486583 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.486805 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.486902 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.487140 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.487229 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.487449 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.487589 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.487760 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.487844 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.488065 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.488149 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.488378 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.488477 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.488687 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.488771 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.488997 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.489080 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.489819 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.489916 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.490128 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.490212 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.490433 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.490516 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.490739 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.490824 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.491069 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.491166 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.491381 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.491467 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.491692 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.491778 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.491996 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.492079 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.492298 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.492389 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.492602 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.492688 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.492925 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.493008 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.493234 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.493316 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.493546 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.493631 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.493856 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.493941 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.494197 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.494290 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.494512 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.494596 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.494823 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.494954 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.495168 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.495298 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.495489 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.495622 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.495797 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.495948 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.496116 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.496267 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.496433 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.496584 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.496750 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.496903 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.497070 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.497212 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.497381 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.497533 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.497709 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.497850 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.498026 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.498167 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.498342 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.498476 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.498669 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.498785 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.499019 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.499138 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.499357 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.499442 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.499668 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.499753 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.499983 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.500070 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.500300 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.500385 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.500613 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.500698 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.500928 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.501015 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.501245 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.501337 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.501563 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.501648 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.501879 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.501964 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.502191 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.502275 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.502504 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.502601 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.502814 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.502898 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.503153 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.503241 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.503474 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.503574 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.503789 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.503885 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.504098 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.504190 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.504429 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.504526 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.504751 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.505345 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.505592 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.505677 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.505905 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.505998 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.506214 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.506349 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.506532 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.506632 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.506838 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.506935 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.507183 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.507294 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.507495 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.507599 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.507812 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.507917 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.508128 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.508235 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.508487 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.508582 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.508802 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.508899 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.509122 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.509219 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.509443 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.509539 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.509753 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.509850 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.510064 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.510166 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.510385 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.510495 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.510708 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.510803 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.511040 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.511138 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.511401 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.511566 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.511724 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.511814 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.512028 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.512123 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.512358 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.512460 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.512665 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.512752 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.512970 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.513056 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.513279 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.513380 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.513604 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.513696 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.513909 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.513996 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.514215 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.514302 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.514533 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.514629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.514862 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.514955 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.515203 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.515299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.515534 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.515707 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.515959 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.516094 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.516278 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.516407 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.516589 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.516718 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.516917 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.517068 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.517247 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.517628 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.517811 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.517977 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.518131 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.518220 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.518446 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.518532 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.518773 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.518859 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.519118 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.519205 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.519431 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.519530 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.519743 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.519827 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.520047 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.520133 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.520396 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.520992 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.521247 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.521333 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.521569 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.521654 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.521877 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.521987 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.522210 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.522308 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.522540 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.522635 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.522861 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.523073 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.523225 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.523311 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.523572 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.523656 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.523887 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.523975 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.524201 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.524288 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.524519 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.524604 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.524833 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.524927 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.525145 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.525231 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.525474 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.525559 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.525787 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.525885 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.526092 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.526177 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.526403 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.526490 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.526712 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.526797 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.527042 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.527132 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.527354 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.527452 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.527670 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.527761 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.527977 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.528061 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.528283 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.528381 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.528592 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.528678 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.528916 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.529001 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.529221 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.529314 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.529538 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.529622 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.529852 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.529936 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.530162 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.530257 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.530473 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.530560 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.530782 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.530874 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.531114 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.531212 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.531435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.531528 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.531748 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.531835 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.532060 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.532147 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.532372 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.532461 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.532707 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.532793 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.533015 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.533148 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.533345 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.533440 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.533679 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.533764 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.534005 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.534092 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.534322 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.534408 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.534646 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.534744 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.534975 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.535079 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.535308 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.535394 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.535617 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.535715 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.535935 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.536073 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.536790 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.536885 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.537101 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.537197 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.537411 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.537496 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.537719 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.537803 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.538028 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.538158 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.538333 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.538417 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.538640 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.538723 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.538954 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.539103 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.539286 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.539383 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.539593 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.539678 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.539903 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.539997 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.540208 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.540293 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.540519 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.540604 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.540829 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.540916 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.541144 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.541227 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.541455 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.541542 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.541767 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.541854 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.542077 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.542171 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.542399 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.542496 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.542721 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.542807 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.543071 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.543160 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.543386 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.543487 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.543709 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.543793 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.544025 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.544109 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.544342 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.544434 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.544662 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.544748 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.544976 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.545061 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.545290 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.545386 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.545606 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.545692 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.545937 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.546074 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.546237 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.546444 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.546559 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.546782 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.546867 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.547131 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.547230 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.547457 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.547725 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.547810 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.548061 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.548147 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.548380 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.548507 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.548694 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.548788 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.549008 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.549103 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.549322 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.549413 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.549634 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.549719 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.549951 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.550046 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.550268 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.550354 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.550585 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.550670 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.550900 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.551013 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.551254 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.551340 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.551580 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.551684 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.551937 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.552023 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.552257 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.552342 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.552586 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.552679 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.552907 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.553003 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.553223 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.553309 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.553538 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.553635 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.553859 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.553944 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.554178 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.554264 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.554495 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.554594 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.554812 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.554898 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.555160 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.555259 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.555479 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.555578 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.555792 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.555877 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.556104 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.556203 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.556420 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.556507 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.556734 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.556819 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.557045 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.557130 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.557361 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.557448 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.557682 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.557768 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.558002 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.558094 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.558323 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.558409 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.558644 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.558729 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.558969 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.559206 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.559297 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.559531 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.559618 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.559872 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.559959 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.560205 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.560430 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.560537 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.560755 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.560861 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.561096 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.561190 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.561429 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.561515 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.561759 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.561845 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.562082 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.562182 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.562393 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.562481 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.562712 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.562806 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.563045 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.563136 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.563360 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.563446 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.563679 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.563765 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.563984 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.564070 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.564292 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.564377 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.564606 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.564690 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.564933 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.565141 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.565228 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.565490 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.565575 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.565815 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.565902 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.566166 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.566371 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.566476 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.566720 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.566823 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.567069 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.567195 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.567931 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.568055 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.568267 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.568384 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.568609 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.568701 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.568910 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.569007 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.569240 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.569338 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.569555 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.569657 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.569864 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.569972 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.570181 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.570271 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.570493 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.570587 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.570800 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.570890 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.571133 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.571235 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.571439 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.571532 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.571756 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.571842 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.572064 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.572152 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.572373 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.572474 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.572682 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.572830 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.572992 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.573133 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.573303 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.573431 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.573611 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.573757 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.573916 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.574059 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.574231 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.574364 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.574543 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.574694 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.574852 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.574996 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.575189 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.575275 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.575495 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.575592 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.575811 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.575896 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.576125 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.576277 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.576443 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.576542 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.576751 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.576835 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.577062 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.577155 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.577372 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.577467 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.577683 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.577769 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.578006 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.578091 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.578323 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.578416 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.578630 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.578740 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.578943 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.579069 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.579279 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.579366 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.579601 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.579685 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.579949 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.580355 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.580463 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.580684 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.580777 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.581007 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.581104 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.581361 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.581456 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.581688 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.581774 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.582034 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.582230 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.582333 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.582571 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.582658 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.583537 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.583635 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.583850 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.584015 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.584192 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.584279 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.584507 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.584592 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.584821 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.584915 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.585135 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.585219 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.585447 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.585531 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.585766 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.585854 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.586080 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.586164 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.586394 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.586536 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.586707 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.586794 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.587038 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.587137 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.587355 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.587446 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.587668 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.587754 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.587981 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.588073 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.588294 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.588388 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.588606 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.588743 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.588939 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.589069 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.589238 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.589334 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.589555 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.589641 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.589872 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.589957 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.590187 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.590282 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.590503 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.590589 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.590818 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.590910 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.591158 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.591247 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.591481 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.591580 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.591800 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.591892 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.592117 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.592211 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.592421 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.592506 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.592732 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.593049 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.593144 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.593370 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.593456 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.593703 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.593790 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.594023 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.594110 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.594335 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.594422 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.594668 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.595019 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.595120 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.595345 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.595430 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.595668 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.595753 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.595990 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.596085 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.596329 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.596481 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.596675 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.596764 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.597002 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.597097 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.597327 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.597413 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.597636 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.597729 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.597949 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.598036 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.598261 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.598347 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.598612 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.598704 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.598940 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.599059 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.599284 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.599370 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.599598 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.599683 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.599906 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.600003 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.600217 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.600302 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.600522 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.600614 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.600834 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.600919 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.601145 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.601230 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.601454 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.601547 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.601809 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.601900 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.602075 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.602162 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.602379 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.602481 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.602683 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.602768 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.603000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.603087 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.603320 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.603417 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.603632 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.603717 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.603942 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.604026 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.604254 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.604340 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.604561 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.604646 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.604870 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.604954 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.605175 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.605267 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.605482 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.605566 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.605798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.605883 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.606110 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.606197 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.606423 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.606554 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.606732 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.606821 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.607066 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.607156 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.607381 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.607468 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.607698 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.607791 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.608027 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.608120 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.608345 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.608430 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.608664 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.608757 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.608977 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.609061 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.609305 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.609406 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.609618 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.609716 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.609936 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.610029 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.610256 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.610342 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.610574 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.610668 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.610886 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.610972 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.611242 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.611328 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.611553 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.611639 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.611870 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.611963 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.612184 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.612269 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.612496 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.612582 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.612811 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.612897 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.613126 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.613212 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.613444 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.613531 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.613762 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.613848 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.614070 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.614208 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.614438 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.614523 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.614749 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.614833 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.615098 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.615201 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.615418 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.615503 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.615730 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.615822 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.616046 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.616139 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.616362 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.616448 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.616673 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.616796 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.616991 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.617078 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.617306 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.617393 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.617624 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.617709 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.617945 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.618039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.618256 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.618341 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.618569 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.618653 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.618893 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.619015 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.619240 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.619339 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.619571 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.619664 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.619898 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.619983 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.620215 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.620300 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.620543 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.620641 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.620862 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.620954 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.621173 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.621259 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.621421 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 18:57:34.621517 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.621841 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.622175 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.622497 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.622814 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.623153 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:57:34.623405 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 18:57:34.774974 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO dbcounter [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] Registered counter for database nova_api Oct 28 18:57:34.776337 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO dbcounter [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] Registered counter for database nova_api Oct 28 18:57:34.796313 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_db.sqlalchemy.engines [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:57:34.799652 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG oslo_db.sqlalchemy.engines [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:57:34.803593 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writer thread running {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:57:34.806280 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writer thread running {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:57:34.860684 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.context [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5dcc3b4c-f46d-4789-b42a-a872c650e37f(cell1) {{(pid=103833) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 18:57:34.862787 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.context [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5dcc3b4c-f46d-4789-b42a-a872c650e37f(cell1) {{(pid=103832) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 18:57:34.864532 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:34.865006 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:34.866629 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:34.866732 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG oslo_concurrency.lockutils [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:34.867126 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG oslo_concurrency.lockutils [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:34.867385 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:34.867833 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:34.868724 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG oslo_concurrency.lockutils [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:34.869437 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG oslo_concurrency.lockutils [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:34.869839 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:34.869951 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG oslo_concurrency.lockutils [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:34.871848 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO dbcounter [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] Registered counter for database nova_cell0 Oct 28 18:57:34.871951 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG oslo_concurrency.lockutils [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:34.873862 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO dbcounter [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] Registered counter for database nova_cell0 Oct 28 18:57:34.875906 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO dbcounter [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] Registered counter for database nova_cell1 Oct 28 18:57:34.878125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO dbcounter [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] Registered counter for database nova_cell1 Oct 28 18:57:34.883579 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_db.sqlalchemy.engines [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:57:34.885668 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_db.sqlalchemy.engines [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:57:34.887391 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG oslo_db.sqlalchemy.engines [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:57:34.889581 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writer thread running {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:57:34.890442 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG oslo_db.sqlalchemy.engines [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:57:34.894987 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writer thread running {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:57:35.032573 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writer thread running {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:57:35.032951 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writer thread running {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:57:35.041492 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO dbcounter [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] Registered counter for database nova_cell0 Oct 28 18:57:35.042753 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO dbcounter [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] Registered counter for database nova_cell0 Oct 28 18:57:35.050325 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_db.sqlalchemy.engines [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:57:35.052701 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG oslo_db.sqlalchemy.engines [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:57:35.055723 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writer thread running {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:57:35.057531 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writer thread running {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:57:35.397581 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: WARNING keystonemiddleware.auth_token [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 18:57:35.399761 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: WARNING keystonemiddleware.auth_token [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 18:57:35.404889 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: WARNING keystonemiddleware.auth_token [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 18:57:35.407164 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: WARNING keystonemiddleware.auth_token [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 18:57:35.750335 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: WARNING keystonemiddleware.auth_token [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 18:57:35.752243 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: WARNING keystonemiddleware.auth_token [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 18:57:35.756320 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: WARNING keystonemiddleware.auth_token [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 18:57:35.758266 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: WARNING keystonemiddleware.auth_token [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 18:57:35.761899 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5638716459c0 pid: 103832 (default app) Oct 28 18:57:35.763652 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5638716459c0 pid: 103833 (default app) Oct 28 18:57:35.764000 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:35.765199 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-1ddf45f7-2b60-4238-ba5e-542ce9b89d1c None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001762 Oct 28 18:57:35.765610 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Fri Oct 28 18:57:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:56.615269 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:56.616368 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002012 Oct 28 18:58:56.616775 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 931 bytes} [Fri Oct 28 18:58:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:58:56.633400 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writing DB stats nova_api:SELECT=3 {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:56.634255 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writing DB stats nova_cell0:SELECT=3 {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:56.635293 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writing DB stats nova_cell1:SELECT=3 {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:56.636337 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:57.483264 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-b67183b5-bd0a-417d-ac35-16063c664a9b admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:57.515005 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-b67183b5-bd0a-417d-ac35-16063c664a9b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.892255 Oct 28 18:58:57.515749 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 2/3] 10.222.0.58 () {60 vars in 1292 bytes} [Fri Oct 28 18:58:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:00.173069 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:00.174085 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-f0d402d8-699b-4f10-888d-ab3cc805f177 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001707 Oct 28 18:59:00.174643 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 2/4] 10.222.0.58 () {54 vars in 931 bytes} [Fri Oct 28 18:59:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:00.641285 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-9431014f-59c4-46ff-9ef6-59fd230abf00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:00.689525 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-9431014f-59c4-46ff-9ef6-59fd230abf00 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.508527 Oct 28 18:59:00.690286 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 3/5] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Oct 28 18:59:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:59:00.703744 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writing DB stats nova_api:SELECT=3 {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:59:00.704554 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writing DB stats nova_cell1:SELECT=3 {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:59:00.706478 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writing DB stats nova_cell0:SELECT=3 {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:59:00.707268 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:59:00.911245 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-ec58bff2-495a-4dc8-94c3-a05206ec850f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:00.977666 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-ec58bff2-495a-4dc8-94c3-a05206ec850f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.279044 Oct 28 18:59:00.978474 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 3/6] 10.222.0.58 () {64 vars in 1336 bytes} [Fri Oct 28 18:59:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:59:03.582686 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-9431014f-59c4-46ff-9ef6-59fd230abf00 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:03.583745 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-9431014f-59c4-46ff-9ef6-59fd230abf00 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 28 18:59:03.584140 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 4/7] 10.222.0.58 () {54 vars in 931 bytes} [Fri Oct 28 18:59:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:04.232144 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-f36b9700-c60f-4de0-acd4-bb55d19f351f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "ds512M", "swap": 0, "disk": 5}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:04.273489 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-f36b9700-c60f-4de0-acd4-bb55d19f351f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.683087 Oct 28 18:59:04.275019 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 4/8] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Oct 28 18:59:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:59:04.288029 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-aa96fedf-38a0-4099-84d5-1b05f3b396ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:04.331317 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-aa96fedf-38a0-4099-84d5-1b05f3b396ad admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047007 Oct 28 18:59:04.331917 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 5/9] 10.222.0.58 () {64 vars in 1336 bytes} [Fri Oct 28 18:59:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:06.928027 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-f36b9700-c60f-4de0-acd4-bb55d19f351f admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:06.929050 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-f36b9700-c60f-4de0-acd4-bb55d19f351f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 28 18:59:06.929477 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 931 bytes} [Fri Oct 28 18:59:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:07.344960 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-5e8b4331-ee0b-4488-9ee6-d8b9b25ed62f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:07.364481 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-5e8b4331-ee0b-4488-9ee6-d8b9b25ed62f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.428251 Oct 28 18:59:07.365044 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 6/11] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Oct 28 18:59:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:59:07.380847 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-523e2fae-eaf7-4662-9ece-56055a8e6aca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:07.413035 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-523e2fae-eaf7-4662-9ece-56055a8e6aca admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038079 Oct 28 18:59:07.413615 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 6/12] 10.222.0.58 () {64 vars in 1336 bytes} [Fri Oct 28 18:59:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:59:10.066223 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-5e8b4331-ee0b-4488-9ee6-d8b9b25ed62f admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:10.067261 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-5e8b4331-ee0b-4488-9ee6-d8b9b25ed62f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 28 18:59:10.067855 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 7/13] 10.222.0.58 () {54 vars in 931 bytes} [Fri Oct 28 18:59:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:10.483735 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-c462b418-6a4e-4295-b8e3-72b1b1895577 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 10, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "ram": 2048}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:10.507010 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-c462b418-6a4e-4295-b8e3-72b1b1895577 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.432780 Oct 28 18:59:10.507600 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 7/14] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Oct 28 18:59:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:59:10.520500 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-14338f20-4301-4325-9ee8-a13225409169 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:10.549462 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-14338f20-4301-4325-9ee8-a13225409169 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033352 Oct 28 18:59:10.550237 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 8/15] 10.222.0.58 () {64 vars in 1336 bytes} [Fri Oct 28 18:59:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:13.240036 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-c462b418-6a4e-4295-b8e3-72b1b1895577 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:13.241080 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-c462b418-6a4e-4295-b8e3-72b1b1895577 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 28 18:59:13.241499 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 8/16] 10.222.0.58 () {54 vars in 931 bytes} [Fri Oct 28 18:59:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:13.683844 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-a2038c7d-2ee2-4bac-b6a8-87d11826259b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "ram": 4096, "name": "ds4G", "vcpus": 4, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:13.704541 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-a2038c7d-2ee2-4bac-b6a8-87d11826259b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.456846 Oct 28 18:59:13.705109 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 9/17] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Oct 28 18:59:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:59:13.717308 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-91027885-1a57-4f1a-b109-9967499663db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:13.741275 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-91027885-1a57-4f1a-b109-9967499663db admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027562 Oct 28 18:59:13.741865 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 9/18] 10.222.0.58 () {64 vars in 1336 bytes} [Fri Oct 28 18:59:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:16.382711 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-a2038c7d-2ee2-4bac-b6a8-87d11826259b admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:16.384932 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-a2038c7d-2ee2-4bac-b6a8-87d11826259b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003650 Oct 28 18:59:16.386078 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 10/19] 10.222.0.58 () {54 vars in 931 bytes} [Fri Oct 28 18:59:16 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:16.877348 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-bbcdd0d3-1cc2-4c6b-a020-ee65c0b5aed2 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:16.902833 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-bbcdd0d3-1cc2-4c6b-a020-ee65c0b5aed2 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.509804 Oct 28 18:59:16.903426 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 10/20] 10.222.0.58 () {60 vars in 1292 bytes} [Fri Oct 28 18:59:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:59:19.497958 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-a2038c7d-2ee2-4bac-b6a8-87d11826259b admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:19.499068 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-a2038c7d-2ee2-4bac-b6a8-87d11826259b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Oct 28 18:59:19.499474 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 11/21] 10.222.0.58 () {54 vars in 931 bytes} [Fri Oct 28 18:59:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:19.916671 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-28465913-4fa2-4e75-90b1-5ab2ba95debb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:19.936073 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-28465913-4fa2-4e75-90b1-5ab2ba95debb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.430471 Oct 28 18:59:19.936713 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 11/22] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Oct 28 18:59:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:59:19.949436 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-262892b2-c5e2-4a7d-96a8-ab0edbdf44db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:19.975745 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-262892b2-c5e2-4a7d-96a8-ab0edbdf44db admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030048 Oct 28 18:59:19.976326 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 12/23] 10.222.0.58 () {64 vars in 1333 bytes} [Fri Oct 28 18:59:19 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:22.574789 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-28465913-4fa2-4e75-90b1-5ab2ba95debb admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:22.575904 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-28465913-4fa2-4e75-90b1-5ab2ba95debb admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 28 18:59:22.576308 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 12/24] 10.222.0.58 () {54 vars in 931 bytes} [Fri Oct 28 18:59:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:22.978712 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-d3e63329-49a6-426e-b318-01c728ee0e8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "ram": 2048, "id": "2", "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:22.998585 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-d3e63329-49a6-426e-b318-01c728ee0e8e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.415516 Oct 28 18:59:22.999157 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 13/25] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Oct 28 18:59:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:59:23.012478 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-f24409df-094e-4c8c-b6a8-1dfb5f74b07d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:23.039667 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-f24409df-094e-4c8c-b6a8-1dfb5f74b07d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030818 Oct 28 18:59:23.040356 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 13/26] 10.222.0.58 () {64 vars in 1333 bytes} [Fri Oct 28 18:59:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:25.688163 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-d3e63329-49a6-426e-b318-01c728ee0e8e admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:25.689178 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-d3e63329-49a6-426e-b318-01c728ee0e8e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002041 Oct 28 18:59:25.689584 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 14/27] 10.222.0.58 () {54 vars in 931 bytes} [Fri Oct 28 18:59:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:26.134560 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-ae3683cd-d856-4c0f-a9c4-11913803731b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "disk": 40}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:26.158507 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-ae3683cd-d856-4c0f-a9c4-11913803731b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.462672 Oct 28 18:59:26.159082 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 14/28] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Oct 28 18:59:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:59:26.171003 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-86b04f65-2500-4ca9-b185-46d32559f360 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:26.199466 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-86b04f65-2500-4ca9-b185-46d32559f360 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031993 Oct 28 18:59:26.215021 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 15/29] 10.222.0.58 () {64 vars in 1333 bytes} [Fri Oct 28 18:59:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:28.828739 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-ae3683cd-d856-4c0f-a9c4-11913803731b admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:28.829914 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-ae3683cd-d856-4c0f-a9c4-11913803731b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002218 Oct 28 18:59:28.830585 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 15/30] 10.222.0.58 () {54 vars in 931 bytes} [Fri Oct 28 18:59:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:29.262349 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-ed027a28-d5a4-4e7f-9fdd-4ce0a499b61a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "id": "4", "disk": 80, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:29.268271 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:59:29.283672 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-ed027a28-d5a4-4e7f-9fdd-4ce0a499b61a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.446956 Oct 28 18:59:29.284398 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 16/31] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Oct 28 18:59:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:59:29.296785 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-fee8feeb-2949-4bd5-aaac-e62be5c6d9b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:29.320847 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-fee8feeb-2949-4bd5-aaac-e62be5c6d9b4 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028192 Oct 28 18:59:29.321597 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 16/32] 10.222.0.58 () {64 vars in 1333 bytes} [Fri Oct 28 18:59:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:31.940973 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-ed027a28-d5a4-4e7f-9fdd-4ce0a499b61a admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:31.941994 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-ed027a28-d5a4-4e7f-9fdd-4ce0a499b61a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 28 18:59:31.942482 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 17/33] 10.222.0.58 () {54 vars in 931 bytes} [Fri Oct 28 18:59:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:32.386847 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-d517b3ba-c48f-4d40-9b86-7c283aa20428 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:32.394953 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:59:32.410975 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-d517b3ba-c48f-4d40-9b86-7c283aa20428 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.461852 Oct 28 18:59:32.411538 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 17/34] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Oct 28 18:59:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:59:32.424168 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-4a4fced9-1197-4b0f-8e5e-b36bd390fabb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:32.450256 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-4a4fced9-1197-4b0f-8e5e-b36bd390fabb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029885 Oct 28 18:59:32.450875 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 18/35] 10.222.0.58 () {64 vars in 1333 bytes} [Fri Oct 28 18:59:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:59:49.456426 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-d517b3ba-c48f-4d40-9b86-7c283aa20428 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:49.457456 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-d517b3ba-c48f-4d40-9b86-7c283aa20428 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 28 18:59:49.457852 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 18/36] 10.222.0.58 () {54 vars in 931 bytes} [Fri Oct 28 18:59:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:49.468497 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:59:49.842940 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-2c35a9ba-cbd8-48f4-8aee-da15a5e8e919 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:49.861784 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-2c35a9ba-cbd8-48f4-8aee-da15a5e8e919 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397793 Oct 28 18:59:49.862317 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 19/37] 10.222.0.58 () {60 vars in 1292 bytes} [Fri Oct 28 18:59:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:59:51.142910 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-d517b3ba-c48f-4d40-9b86-7c283aa20428 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:51.144007 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-d517b3ba-c48f-4d40-9b86-7c283aa20428 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Oct 28 18:59:51.144401 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 19/38] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Oct 28 18:59:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:51.661661 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-1bdac5c7-0420-45d9-b6b8-4e7dcae88391 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:51.666906 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.wsgi [None req-1bdac5c7-0420-45d9-b6b8-4e7dcae88391 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-1bdac5c7-0420-45d9-b6b8-4e7dcae88391 admin admin] Request method failure captured: Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Accept: application/json Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Accept-Encoding: gzip, deflate Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Connection: keep-alive Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Content-Length: 0 Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Host: 10.222.0.58 Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Openstack-Api-Version: compute 2.92 Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Openstack-System-Scope: None Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: User-Agent: python-novaclient Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Auth-Token: gAAAAABjXCank7owPVPHtr2yNaugwA6V4GtiWSkRWYZR-vPCPWGQzQdkiGA6th2mZgNqbOh1k8nUQzSWYwXeNs_CEvI0tOSG_c1dDpSFrJShql7EuAExbIIQe5RrTzFigXB9LOFEHXl02aDnLyaAk2MrjC-cs_RD1S9ljWpm5RHRj5NnKziY35k Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Domain-Id: None Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Domain-Name: None Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Identity-Status: Confirmed Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Is-Admin-Project: True Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Project-Domain-Id: default Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Project-Domain-Name: Default Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Project-Id: b28e4680a856417f99f9b94c78ac743d Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Project-Name: admin Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Role: member,admin,reader Oct 28 18:59:51.670629 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Roles: member,admin,reader Oct 28 18:59:51.672354 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 18:59:51.672354 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Tenant: admin Oct 28 18:59:51.672354 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Tenant-Id: b28e4680a856417f99f9b94c78ac743d Oct 28 18:59:51.672354 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Tenant-Name: admin Oct 28 18:59:51.672354 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-User: admin Oct 28 18:59:51.672354 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-User-Domain-Id: default Oct 28 18:59:51.672354 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-User-Domain-Name: Default Oct 28 18:59:51.672354 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-User-Id: d171ff8c81304d799c869856dff7ee6d Oct 28 18:59:51.672354 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-User-Name: admin Oct 28 18:59:51.672354 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: method: > Oct 28 18:59:51.672354 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: exception: Flavor 42 could not be found. Oct 28 18:59:51.672354 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: action_args: {'id': '42'} Oct 28 18:59:51.672354 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:59:51.672354 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:51.673296 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:51.674643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:59:51.674643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:59:51.674643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:59:51.674643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:51.674643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 18:59:51.674643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:59:51.674643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 28 18:59:51.674643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Oct 28 18:59:51.674643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:51.674643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Oct 28 18:59:51.674643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:51.674643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:51.674643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:51.674643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:59:51.674643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:59:51.674643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 28 18:59:51.674643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Oct 28 18:59:51.674643 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-1bdac5c7-0420-45d9-b6b8-4e7dcae88391 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:59:51.676047 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-1bdac5c7-0420-45d9-b6b8-4e7dcae88391 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.386996 Oct 28 18:59:51.676047 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 20/39] 10.222.0.58 () {60 vars in 1190 bytes} [Fri Oct 28 18:59:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 28 18:59:51.682038 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-1d1de14e-438c-47c2-ac51-122fda89ec23 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:51.704923 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-1d1de14e-438c-47c2-ac51-122fda89ec23 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026827 Oct 28 18:59:51.705464 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 20/40] 10.222.0.58 () {60 vars in 1210 bytes} [Fri Oct 28 18:59:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:59:51.715948 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-99c85d68-21de-480a-98be-fb2b648374da admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:51.738315 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-99c85d68-21de-480a-98be-fb2b648374da admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026848 Oct 28 18:59:51.738871 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 21/41] 10.222.0.58 () {60 vars in 1210 bytes} [Fri Oct 28 18:59:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:59:51.749082 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-62e45223-1782-41ae-889c-9c46e08e8df3 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:51.754480 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.wsgi [None req-62e45223-1782-41ae-889c-9c46e08e8df3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-62e45223-1782-41ae-889c-9c46e08e8df3 admin admin] Request method failure captured: Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Accept: application/json Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Accept-Encoding: gzip, deflate Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Connection: keep-alive Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Content-Length: 0 Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Host: 10.222.0.58 Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Openstack-Api-Version: compute 2.92 Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Openstack-System-Scope: None Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: User-Agent: python-novaclient Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Auth-Token: gAAAAABjXCank7owPVPHtr2yNaugwA6V4GtiWSkRWYZR-vPCPWGQzQdkiGA6th2mZgNqbOh1k8nUQzSWYwXeNs_CEvI0tOSG_c1dDpSFrJShql7EuAExbIIQe5RrTzFigXB9LOFEHXl02aDnLyaAk2MrjC-cs_RD1S9ljWpm5RHRj5NnKziY35k Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Domain-Id: None Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Domain-Name: None Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Identity-Status: Confirmed Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Is-Admin-Project: True Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Project-Domain-Id: default Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Project-Domain-Name: Default Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Project-Id: b28e4680a856417f99f9b94c78ac743d Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Project-Name: admin Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Role: member,admin,reader Oct 28 18:59:51.757765 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Roles: member,admin,reader Oct 28 18:59:51.759248 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 18:59:51.759248 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Tenant: admin Oct 28 18:59:51.759248 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Tenant-Id: b28e4680a856417f99f9b94c78ac743d Oct 28 18:59:51.759248 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Tenant-Name: admin Oct 28 18:59:51.759248 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-User: admin Oct 28 18:59:51.759248 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-User-Domain-Id: default Oct 28 18:59:51.759248 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-User-Domain-Name: Default Oct 28 18:59:51.759248 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-User-Id: d171ff8c81304d799c869856dff7ee6d Oct 28 18:59:51.759248 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-User-Name: admin Oct 28 18:59:51.759248 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: method: > Oct 28 18:59:51.759248 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: exception: Flavor 42 could not be found. Oct 28 18:59:51.759248 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: action_args: {'id': '42'} Oct 28 18:59:51.759248 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:59:51.759248 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:51.760141 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:51.761171 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:59:51.761171 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:59:51.761171 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:59:51.761171 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:51.761171 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 18:59:51.761171 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:59:51.761171 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 28 18:59:51.761171 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Oct 28 18:59:51.761171 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:51.761171 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Oct 28 18:59:51.761171 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:51.761171 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:51.761171 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:51.761171 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:59:51.761171 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:59:51.761171 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 28 18:59:51.761171 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Oct 28 18:59:51.761171 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-62e45223-1782-41ae-889c-9c46e08e8df3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:59:51.762150 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-62e45223-1782-41ae-889c-9c46e08e8df3 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014469 Oct 28 18:59:51.762150 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 21/42] 10.222.0.58 () {60 vars in 1190 bytes} [Fri Oct 28 18:59:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:59:52.953051 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-99c85d68-21de-480a-98be-fb2b648374da admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:52.954075 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-99c85d68-21de-480a-98be-fb2b648374da admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 28 18:59:52.954500 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 22/43] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Oct 28 18:59:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:59:53.474589 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-92be62d0-ca26-4f6f-aed4-c6ead9a89707 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:53.479565 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.wsgi [None req-92be62d0-ca26-4f6f-aed4-c6ead9a89707 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-92be62d0-ca26-4f6f-aed4-c6ead9a89707 admin admin] Request method failure captured: Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Accept: application/json Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Accept-Encoding: gzip, deflate Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Connection: keep-alive Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Content-Length: 0 Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Host: 10.222.0.58 Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Openstack-Api-Version: compute 2.92 Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Openstack-System-Scope: None Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: User-Agent: python-novaclient Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Auth-Token: gAAAAABjXCaoAf74UNoEQVFg3LdDnMKly5a_-HIp53NYY5yGD-oFxHtuFHRn7DyVSl8ZyG5xckIrMxefxjfguj-kv4xmTdmUMcekqBs-bkyPi0o1GxosUNKHfwrHa-RwDKcr86yPM09l1w2371aGcqKVfaa8iDKlLPa4Pz6i8eE8PE40GivkL68 Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Domain-Id: None Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Domain-Name: None Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Identity-Status: Confirmed Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Is-Admin-Project: True Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Project-Domain-Id: default Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Project-Domain-Name: Default Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Project-Id: b28e4680a856417f99f9b94c78ac743d Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Project-Name: admin Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Role: member,admin,reader Oct 28 18:59:53.481051 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Roles: member,admin,reader Oct 28 18:59:53.482592 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 18:59:53.482592 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Tenant: admin Oct 28 18:59:53.482592 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Tenant-Id: b28e4680a856417f99f9b94c78ac743d Oct 28 18:59:53.482592 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Tenant-Name: admin Oct 28 18:59:53.482592 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-User: admin Oct 28 18:59:53.482592 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-User-Domain-Id: default Oct 28 18:59:53.482592 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-User-Domain-Name: Default Oct 28 18:59:53.482592 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-User-Id: d171ff8c81304d799c869856dff7ee6d Oct 28 18:59:53.482592 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-User-Name: admin Oct 28 18:59:53.482592 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: method: > Oct 28 18:59:53.482592 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: exception: Flavor 84 could not be found. Oct 28 18:59:53.482592 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: action_args: {'id': '84'} Oct 28 18:59:53.482592 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:59:53.482592 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:53.483702 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:53.484798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:59:53.484798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:59:53.484798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:59:53.484798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:53.484798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 18:59:53.484798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:59:53.484798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 28 18:59:53.484798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Oct 28 18:59:53.484798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:53.484798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Oct 28 18:59:53.484798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:53.484798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:53.484798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:53.484798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:59:53.484798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:59:53.484798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 28 18:59:53.484798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Oct 28 18:59:53.484798 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-92be62d0-ca26-4f6f-aed4-c6ead9a89707 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:59:53.485872 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-92be62d0-ca26-4f6f-aed4-c6ead9a89707 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.391028 Oct 28 18:59:53.485872 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 22/44] 10.222.0.58 () {60 vars in 1190 bytes} [Fri Oct 28 18:59:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 28 18:59:53.492012 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-69e0c947-4b6a-4323-8edd-ebaa12d79582 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:53.507269 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-69e0c947-4b6a-4323-8edd-ebaa12d79582 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018819 Oct 28 18:59:53.507830 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 23/45] 10.222.0.58 () {60 vars in 1210 bytes} [Fri Oct 28 18:59:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:59:53.517965 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-4d6ffd91-0b9d-49b1-af9e-d6abdc67ff4d admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:53.533405 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-4d6ffd91-0b9d-49b1-af9e-d6abdc67ff4d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019761 Oct 28 18:59:53.533930 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 23/46] 10.222.0.58 () {60 vars in 1210 bytes} [Fri Oct 28 18:59:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:59:53.543068 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-5216881c-e1ab-4bbf-9d7f-730f2fcf11d6 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:53.548544 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.wsgi [None req-5216881c-e1ab-4bbf-9d7f-730f2fcf11d6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-5216881c-e1ab-4bbf-9d7f-730f2fcf11d6 admin admin] Request method failure captured: Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Accept: application/json Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Accept-Encoding: gzip, deflate Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Connection: keep-alive Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Content-Length: 0 Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Host: 10.222.0.58 Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Openstack-Api-Version: compute 2.92 Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Openstack-System-Scope: None Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: User-Agent: python-novaclient Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Auth-Token: gAAAAABjXCaoAf74UNoEQVFg3LdDnMKly5a_-HIp53NYY5yGD-oFxHtuFHRn7DyVSl8ZyG5xckIrMxefxjfguj-kv4xmTdmUMcekqBs-bkyPi0o1GxosUNKHfwrHa-RwDKcr86yPM09l1w2371aGcqKVfaa8iDKlLPa4Pz6i8eE8PE40GivkL68 Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Domain-Id: None Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Domain-Name: None Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Identity-Status: Confirmed Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Is-Admin-Project: True Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Project-Domain-Id: default Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Project-Domain-Name: Default Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Project-Id: b28e4680a856417f99f9b94c78ac743d Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Project-Name: admin Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Role: member,admin,reader Oct 28 18:59:53.550039 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Roles: member,admin,reader Oct 28 18:59:53.551615 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 18:59:53.551615 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Tenant: admin Oct 28 18:59:53.551615 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Tenant-Id: b28e4680a856417f99f9b94c78ac743d Oct 28 18:59:53.551615 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Tenant-Name: admin Oct 28 18:59:53.551615 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-User: admin Oct 28 18:59:53.551615 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-User-Domain-Id: default Oct 28 18:59:53.551615 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-User-Domain-Name: Default Oct 28 18:59:53.551615 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-User-Id: d171ff8c81304d799c869856dff7ee6d Oct 28 18:59:53.551615 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-User-Name: admin Oct 28 18:59:53.551615 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: method: > Oct 28 18:59:53.551615 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: exception: Flavor 84 could not be found. Oct 28 18:59:53.551615 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: action_args: {'id': '84'} Oct 28 18:59:53.551615 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:59:53.551615 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:53.552714 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:53.554299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:59:53.554299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:59:53.554299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:59:53.554299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:53.554299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 18:59:53.554299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:59:53.554299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 28 18:59:53.554299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Oct 28 18:59:53.554299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:53.554299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Oct 28 18:59:53.554299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:53.554299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:53.554299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:53.554299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:59:53.554299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:59:53.554299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 28 18:59:53.554299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Oct 28 18:59:53.554299 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-5216881c-e1ab-4bbf-9d7f-730f2fcf11d6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:59:53.555634 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-5216881c-e1ab-4bbf-9d7f-730f2fcf11d6 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011806 Oct 28 18:59:53.555634 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 24/47] 10.222.0.58 () {60 vars in 1190 bytes} [Fri Oct 28 18:59:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:59:54.745873 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-4d6ffd91-0b9d-49b1-af9e-d6abdc67ff4d admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:54.746903 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-4d6ffd91-0b9d-49b1-af9e-d6abdc67ff4d admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 28 18:59:54.747333 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 24/48] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Oct 28 18:59:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:55.257812 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-7b6ed860-0f85-4ab2-b631-b2d17ded6190 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:55.263628 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.wsgi [None req-7b6ed860-0f85-4ab2-b631-b2d17ded6190 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-7b6ed860-0f85-4ab2-b631-b2d17ded6190 admin admin] Request method failure captured: Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Accept: application/json Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Accept-Encoding: gzip, deflate Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Connection: keep-alive Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Content-Length: 0 Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Host: 10.222.0.58 Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Openstack-Api-Version: compute 2.92 Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Openstack-System-Scope: None Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: User-Agent: python-novaclient Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Auth-Token: gAAAAABjXCaqkFSgRdP4mTSaJ1fxes9M9Nv41G2Fwb9sj7hp6zQmeyTIDE4J_OI2KyOo4gG2ol4tTaFucGrK92F9C-fIxHoG-uTeQTpb9hUPj9JIjrd_Vs0YIwzrcgPHxop623MhLZA7XkVmstJRtr44I6T8D4CwS1q3plHilIRr9fhRJcCDUKM Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Domain-Id: None Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Domain-Name: None Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Identity-Status: Confirmed Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Is-Admin-Project: True Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Project-Domain-Id: default Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Project-Domain-Name: Default Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Project-Id: b28e4680a856417f99f9b94c78ac743d Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Project-Name: admin Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Role: member,admin,reader Oct 28 18:59:55.265125 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Roles: member,admin,reader Oct 28 18:59:55.266873 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 18:59:55.266873 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Tenant: admin Oct 28 18:59:55.266873 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Tenant-Id: b28e4680a856417f99f9b94c78ac743d Oct 28 18:59:55.266873 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-Tenant-Name: admin Oct 28 18:59:55.266873 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-User: admin Oct 28 18:59:55.266873 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-User-Domain-Id: default Oct 28 18:59:55.266873 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-User-Domain-Name: Default Oct 28 18:59:55.266873 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-User-Id: d171ff8c81304d799c869856dff7ee6d Oct 28 18:59:55.266873 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: X-User-Name: admin Oct 28 18:59:55.266873 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: method: > Oct 28 18:59:55.266873 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: exception: Flavor 451 could not be found. Oct 28 18:59:55.266873 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: action_args: {'id': '451'} Oct 28 18:59:55.266873 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:59:55.266873 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:55.267894 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:55.269142 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:59:55.269142 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:59:55.269142 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:59:55.269142 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:55.269142 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 18:59:55.269142 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:59:55.269142 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 28 18:59:55.269142 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Oct 28 18:59:55.269142 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:55.269142 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Oct 28 18:59:55.269142 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:55.269142 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:55.269142 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:55.269142 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:59:55.269142 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:59:55.269142 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 28 18:59:55.269142 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Oct 28 18:59:55.269142 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-7b6ed860-0f85-4ab2-b631-b2d17ded6190 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:59:55.270336 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-7b6ed860-0f85-4ab2-b631-b2d17ded6190 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.382547 Oct 28 18:59:55.270336 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 25/49] 10.222.0.58 () {60 vars in 1193 bytes} [Fri Oct 28 18:59:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:59:55.276595 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-fd875d6c-e045-4d7a-8f0f-d7349df4c71c admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:55.291225 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-fd875d6c-e045-4d7a-8f0f-d7349df4c71c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018201 Oct 28 18:59:55.291745 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 25/50] 10.222.0.58 () {60 vars in 1210 bytes} [Fri Oct 28 18:59:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:59:55.301388 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-7ad50dee-c659-42f2-b226-9398a088e2d8 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:55.316488 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-7ad50dee-c659-42f2-b226-9398a088e2d8 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018566 Oct 28 18:59:55.317013 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 26/51] 10.222.0.58 () {60 vars in 1210 bytes} [Fri Oct 28 18:59:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:59:55.325675 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-8c6cecda-cd62-419a-8f16-b7620ed68db5 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:55.330482 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.wsgi [None req-8c6cecda-cd62-419a-8f16-b7620ed68db5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-8c6cecda-cd62-419a-8f16-b7620ed68db5 admin admin] Request method failure captured: Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Accept: application/json Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Accept-Encoding: gzip, deflate Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Connection: keep-alive Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Content-Length: 0 Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Host: 10.222.0.58 Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Openstack-Api-Version: compute 2.92 Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Openstack-System-Scope: None Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: User-Agent: python-novaclient Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Auth-Token: gAAAAABjXCaqkFSgRdP4mTSaJ1fxes9M9Nv41G2Fwb9sj7hp6zQmeyTIDE4J_OI2KyOo4gG2ol4tTaFucGrK92F9C-fIxHoG-uTeQTpb9hUPj9JIjrd_Vs0YIwzrcgPHxop623MhLZA7XkVmstJRtr44I6T8D4CwS1q3plHilIRr9fhRJcCDUKM Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Domain-Id: None Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Domain-Name: None Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Identity-Status: Confirmed Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Is-Admin-Project: True Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Project-Domain-Id: default Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Project-Domain-Name: Default Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Project-Id: b28e4680a856417f99f9b94c78ac743d Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Project-Name: admin Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Role: member,admin,reader Oct 28 18:59:55.332000 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Roles: member,admin,reader Oct 28 18:59:55.333630 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b28e4680a856417f99f9b94c78ac743d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 18:59:55.333630 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Tenant: admin Oct 28 18:59:55.333630 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Tenant-Id: b28e4680a856417f99f9b94c78ac743d Oct 28 18:59:55.333630 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-Tenant-Name: admin Oct 28 18:59:55.333630 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-User: admin Oct 28 18:59:55.333630 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-User-Domain-Id: default Oct 28 18:59:55.333630 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-User-Domain-Name: Default Oct 28 18:59:55.333630 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-User-Id: d171ff8c81304d799c869856dff7ee6d Oct 28 18:59:55.333630 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: X-User-Name: admin Oct 28 18:59:55.333630 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: method: > Oct 28 18:59:55.333630 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: exception: Flavor 451 could not be found. Oct 28 18:59:55.333630 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: action_args: {'id': '451'} Oct 28 18:59:55.333630 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:59:55.333630 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:55.334435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:55.335709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:59:55.335709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:59:55.335709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:59:55.335709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:55.335709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 18:59:55.335709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:59:55.335709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 28 18:59:55.335709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Oct 28 18:59:55.335709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:55.335709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Oct 28 18:59:55.335709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:55.335709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:55.335709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:55.335709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:59:55.335709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:59:55.335709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 28 18:59:55.335709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Oct 28 18:59:55.335709 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-8c6cecda-cd62-419a-8f16-b7620ed68db5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:59:55.336899 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-8c6cecda-cd62-419a-8f16-b7620ed68db5 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011025 Oct 28 18:59:55.336899 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 26/52] 10.222.0.58 () {60 vars in 1193 bytes} [Fri Oct 28 18:59:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 28 18:59:56.538759 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-7ad50dee-c659-42f2-b226-9398a088e2d8 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:56.539806 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-7ad50dee-c659-42f2-b226-9398a088e2d8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 28 18:59:56.540248 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 27/53] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Oct 28 18:59:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:57.059745 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-fcfd9d84-b96e-442b-b684-75f6301d39f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:57.079684 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-fcfd9d84-b96e-442b-b684-75f6301d39f8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.402638 Oct 28 18:59:57.080221 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 27/54] 10.222.0.58 () {64 vars in 1235 bytes} [Fri Oct 28 18:59:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:59:58.271410 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-7ad50dee-c659-42f2-b226-9398a088e2d8 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:58.272416 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-7ad50dee-c659-42f2-b226-9398a088e2d8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 28 18:59:58.272812 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 28/55] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Oct 28 18:59:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:58.789332 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-da865cbe-be1a-4920-8af2-869bfd412711 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:58.807984 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-da865cbe-be1a-4920-8af2-869bfd412711 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.397502 Oct 28 18:59:58.808534 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 28/56] 10.222.0.58 () {64 vars in 1235 bytes} [Fri Oct 28 18:59:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:00:00.018418 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-7ad50dee-c659-42f2-b226-9398a088e2d8 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:00.019476 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-7ad50dee-c659-42f2-b226-9398a088e2d8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 28 19:00:00.019877 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 29/57] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Oct 28 19:00:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:00:00.533724 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-2a54a75a-b3c2-46a8-9aa3-9c181bae40d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:00:00.552452 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-2a54a75a-b3c2-46a8-9aa3-9c181bae40d3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.396648 Oct 28 19:00:00.553012 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 29/58] 10.222.0.58 () {64 vars in 1235 bytes} [Fri Oct 28 19:00:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:00:01.758321 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-7ad50dee-c659-42f2-b226-9398a088e2d8 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:01.759372 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-7ad50dee-c659-42f2-b226-9398a088e2d8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 28 19:00:01.759769 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 30/59] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Oct 28 19:00:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:00:02.276185 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-9c229c03-ad90-40f0-84e4-d46dc88e1c5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:00:02.294731 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-9c229c03-ad90-40f0-84e4-d46dc88e1c5e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.396878 Oct 28 19:00:02.295321 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 30/60] 10.222.0.58 () {64 vars in 1235 bytes} [Fri Oct 28 19:00:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:00:03.498291 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-7ad50dee-c659-42f2-b226-9398a088e2d8 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:03.499326 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-7ad50dee-c659-42f2-b226-9398a088e2d8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Oct 28 19:00:03.499723 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 31/61] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Oct 28 19:00:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:00:04.021851 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-658121d2-c7d4-45d0-9e72-6b8f06ada8f5 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:04.041864 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-658121d2-c7d4-45d0-9e72-6b8f06ada8f5 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.405945 Oct 28 19:00:04.042406 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 31/62] 10.222.0.58 () {60 vars in 1202 bytes} [Fri Oct 28 19:00:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:01:00.338496 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-7ad50dee-c659-42f2-b226-9398a088e2d8 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:00.339457 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-7ad50dee-c659-42f2-b226-9398a088e2d8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 28 19:01:00.339866 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 32/63] 10.222.0.58 () {54 vars in 931 bytes} [Fri Oct 28 19:01:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:01:00.350255 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:00.722567 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-99ebda5a-fe78-4feb-a3a6-8b94bfe942f4 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:00.743405 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-99ebda5a-fe78-4feb-a3a6-8b94bfe942f4 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.397541 Oct 28 19:01:00.743951 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 32/64] 10.222.0.58 () {60 vars in 1292 bytes} [Fri Oct 28 19:01:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:01:00.765953 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writing DB stats nova_api:SELECT=14 {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:00.769748 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-3b6ca0d6-d711-4e78-87f4-97b34fffea07 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:00.777210 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-3b6ca0d6-d711-4e78-87f4-97b34fffea07 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012991 Oct 28 19:01:00.778225 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 33/65] 10.222.0.58 () {60 vars in 1283 bytes} [Fri Oct 28 19:01:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:00.789838 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-9b8c8b8e-e6eb-4336-9825-3785d8d78ea1 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:00.797618 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-9b8c8b8e-e6eb-4336-9825-3785d8d78ea1 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011331 Oct 28 19:01:00.798128 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 33/66] 10.222.0.58 () {60 vars in 1286 bytes} [Fri Oct 28 19:01:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:00.809097 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-45beeb7d-7cc5-4371-a33d-a6456cc0f32c admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:00.816208 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-45beeb7d-7cc5-4371-a33d-a6456cc0f32c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010605 Oct 28 19:01:00.816721 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 34/67] 10.222.0.58 () {60 vars in 1286 bytes} [Fri Oct 28 19:01:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:00.827573 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-51b5c8ee-8548-4d45-8f62-1e7e6888398c admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:00.834473 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-51b5c8ee-8548-4d45-8f62-1e7e6888398c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010285 Oct 28 19:01:00.835003 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 34/68] 10.222.0.58 () {60 vars in 1283 bytes} [Fri Oct 28 19:01:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:57.371361 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-45beeb7d-7cc5-4371-a33d-a6456cc0f32c admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:57.372374 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-45beeb7d-7cc5-4371-a33d-a6456cc0f32c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 28 19:03:57.372765 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 35/69] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Oct 28 19:03:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:03:57.513422 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writing DB stats nova_api:SELECT=6 {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:57.672689 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-6a934e36-7149-4b0d-8a5c-4d2d81e4026d admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:57.677445 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-6a934e36-7149-4b0d-8a5c-4d2d81e4026d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:57.677924 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-6a934e36-7149-4b0d-8a5c-4d2d81e4026d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:57.678354 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-6a934e36-7149-4b0d-8a5c-4d2d81e4026d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:57.679102 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-6a934e36-7149-4b0d-8a5c-4d2d81e4026d admin admin] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:57.679552 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-6a934e36-7149-4b0d-8a5c-4d2d81e4026d admin admin] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:57.679977 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-6a934e36-7149-4b0d-8a5c-4d2d81e4026d admin admin] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:57.711979 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-6a934e36-7149-4b0d-8a5c-4d2d81e4026d admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.199697 Oct 28 19:03:57.712532 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 35/70] 10.222.0.58 () {60 vars in 1193 bytes} [Fri Oct 28 19:03:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:03:58.784081 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-45beeb7d-7cc5-4371-a33d-a6456cc0f32c admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:58.785077 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-45beeb7d-7cc5-4371-a33d-a6456cc0f32c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Oct 28 19:03:58.785534 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 36/71] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Oct 28 19:03:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:03:58.976046 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-50d8d551-debc-428a-b03d-a4ab82d34233 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:58.979435 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-50d8d551-debc-428a-b03d-a4ab82d34233 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:58.979953 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-50d8d551-debc-428a-b03d-a4ab82d34233 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:58.980406 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-50d8d551-debc-428a-b03d-a4ab82d34233 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:58.981109 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-50d8d551-debc-428a-b03d-a4ab82d34233 admin admin] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:58.981550 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-50d8d551-debc-428a-b03d-a4ab82d34233 admin admin] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:58.981964 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-50d8d551-debc-428a-b03d-a4ab82d34233 admin admin] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:59.001880 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-50d8d551-debc-428a-b03d-a4ab82d34233 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077136 Oct 28 19:03:59.002351 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 36/72] 10.222.0.58 () {60 vars in 1193 bytes} [Fri Oct 28 19:03:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:04:10.464646 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-45beeb7d-7cc5-4371-a33d-a6456cc0f32c admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:10.466060 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-45beeb7d-7cc5-4371-a33d-a6456cc0f32c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001820 Oct 28 19:04:10.466534 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 37/73] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Oct 28 19:04:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:04:10.609657 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writing DB stats nova_cell0:SELECT=4 {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:10.610382 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writing DB stats nova_cell1:SELECT=4 {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:10.611007 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writing DB stats nova_api:SELECT=8 {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:10.660007 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-dc0066ab-3eaf-4c76-9cb7-d1b9000ebf4d admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:10.663434 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-dc0066ab-3eaf-4c76-9cb7-d1b9000ebf4d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:10.663908 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-dc0066ab-3eaf-4c76-9cb7-d1b9000ebf4d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:10.664334 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-dc0066ab-3eaf-4c76-9cb7-d1b9000ebf4d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:10.665044 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-dc0066ab-3eaf-4c76-9cb7-d1b9000ebf4d admin admin] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:10.665488 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-dc0066ab-3eaf-4c76-9cb7-d1b9000ebf4d admin admin] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:10.665906 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-dc0066ab-3eaf-4c76-9cb7-d1b9000ebf4d admin admin] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:10.691064 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-dc0066ab-3eaf-4c76-9cb7-d1b9000ebf4d admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.085803 Oct 28 19:04:10.691544 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 37/74] 10.222.0.58 () {60 vars in 1193 bytes} [Fri Oct 28 19:04:10 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:04:11.740504 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-45beeb7d-7cc5-4371-a33d-a6456cc0f32c admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:11.741502 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-45beeb7d-7cc5-4371-a33d-a6456cc0f32c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002083 Oct 28 19:04:11.741897 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 38/75] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Oct 28 19:04:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:04:11.933144 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-590eff45-bc14-487d-b2db-682d9fafcd76 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:11.936544 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-590eff45-bc14-487d-b2db-682d9fafcd76 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:11.937017 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-590eff45-bc14-487d-b2db-682d9fafcd76 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:11.937443 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-590eff45-bc14-487d-b2db-682d9fafcd76 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:11.938151 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-590eff45-bc14-487d-b2db-682d9fafcd76 admin admin] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:11.938594 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-590eff45-bc14-487d-b2db-682d9fafcd76 admin admin] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:11.939030 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-590eff45-bc14-487d-b2db-682d9fafcd76 admin admin] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:11.960588 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-590eff45-bc14-487d-b2db-682d9fafcd76 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.082497 Oct 28 19:04:11.961129 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 38/76] 10.222.0.58 () {60 vars in 1193 bytes} [Fri Oct 28 19:04:11 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:05:08.898042 dv-cinder-862365-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 28 19:05:08.910626 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: Fri Oct 28 19:05:08 2022 - graceful shutdown triggered... Oct 28 19:05:08.911288 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: Gracefully killing worker 1 (pid: 103832)... Oct 28 19:05:08.911669 dv-cinder-862365-1-iscsi devstack@n-api.service[103833]: Gracefully killing worker 2 (pid: 103833)... Oct 28 19:05:09.024769 dv-cinder-862365-1-iscsi devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writing DB stats nova_api:SELECT=4 {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:09.899917 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: worker 1 buried after 1 seconds Oct 28 19:05:09.899917 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: worker 2 buried after 1 seconds Oct 28 19:05:09.899917 dv-cinder-862365-1-iscsi devstack@n-api.service[103831]: goodbye to uWSGI. Oct 28 19:05:09.901592 dv-cinder-862365-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 28 19:05:09.902182 dv-cinder-862365-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 28 19:05:09.904847 dv-cinder-862365-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 19:05:09.918559 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 19:05:09.920707 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 19:05:09 2022] *** Oct 28 19:05:09.920707 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 19:05:09.920707 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 19:05:09.920707 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: nodename: dv-cinder-862365-1-iscsi Oct 28 19:05:09.920707 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: machine: x86_64 Oct 28 19:05:09.920707 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: clock source: unix Oct 28 19:05:09.920707 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: pcre jit disabled Oct 28 19:05:09.920707 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: detected number of CPU cores: 4 Oct 28 19:05:09.920707 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: current working directory: / Oct 28 19:05:09.920707 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: detected binary path: /usr/bin/uwsgi-core Oct 28 19:05:09.921491 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: your processes number limit is 47680 Oct 28 19:05:09.921491 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: your memory page size is 4096 bytes Oct 28 19:05:09.921491 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: detected max file descriptor number: 2048 Oct 28 19:05:09.921491 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: lock engine: pthread robust mutexes Oct 28 19:05:09.921491 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: thunder lock: enabled Oct 28 19:05:09.921491 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 19:05:09.921491 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 19:05:09.964092 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: Python main interpreter initialized at 0x55810a3ba9c0 Oct 28 19:05:09.964092 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: python threads support enabled Oct 28 19:05:09.964092 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: your server socket listen backlog is limited to 100 connections Oct 28 19:05:09.964092 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: your mercy for graceful operations on workers is 90 seconds Oct 28 19:05:09.964529 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 19:05:09.964529 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: *** Operational MODE: preforking *** Oct 28 19:05:09.964805 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: *** uWSGI is running in multiple interpreter mode *** Oct 28 19:05:09.964805 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: spawned uWSGI master process (pid: 118855) Oct 28 19:05:09.965017 dv-cinder-862365-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 28 19:05:09.967801 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: spawned uWSGI worker 1 (pid: 118874, cores: 1) Oct 28 19:05:09.967801 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: spawned uWSGI worker 2 (pid: 118875, cores: 1) Oct 28 19:05:09.967801 dv-cinder-862365-1-iscsi devstack@n-api.service[118855]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 19:05:10.624672 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 19:05:10.635815 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 19:05:11.870425 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:05:11.870425 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: from cryptography.utils import int_from_bytes Oct 28 19:05:11.871188 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:05:11.871188 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: from cryptography.utils import int_from_bytes Oct 28 19:05:11.882360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:05:11.882360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: from cryptography.utils import int_from_bytes Oct 28 19:05:11.882866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:05:11.882866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: from cryptography.utils import int_from_bytes Oct 28 19:05:14.301732 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 19:05:14.302422 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 19:05:14.303333 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 19:05:14.303428 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 19:05:14.303513 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 19:05:14.303592 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 19:05:14.303672 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 19:05:14.303759 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 19:05:14.303843 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 19:05:14.303921 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 19:05:14.304003 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.304372 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.304483 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.304576 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.304659 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.304844 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.304949 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.305134 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.305463 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.305572 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.305773 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.305882 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.306094 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.306268 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.306422 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.306614 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.306777 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.306941 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.306941 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.307295 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.307454 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.307618 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862365-1-iscsi {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.307771 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862365-1-iscsi {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.307928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.308086 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.308243 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.308394 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.308548 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.308703 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.308859 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.309050 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.309209 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.309365 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.309518 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.309670 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.309829 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.309980 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.311458 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.311642 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.311834 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.312002 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.312169 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.312323 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.312474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.312630 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.312630 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.312927 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.313082 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.313082 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.313365 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.313520 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.313520 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.313820 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.313972 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.313972 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.314253 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.314409 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862365-1-iscsi {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.314567 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.314721 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.314721 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.315039 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.315191 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.315191 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.315491 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.315643 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.315643 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.316720 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862365-1-iscsi {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.316893 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.316893 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.317210 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.317366 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.317517 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.317671 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.317837 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.317994 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.317994 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.318287 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.319099 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.319261 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.319422 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.319578 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.319731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.319885 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.320039 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.320191 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.320354 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.320505 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.320657 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.320807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.320962 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.321118 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.321277 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.321425 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.321628 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.321773 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.321923 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.322081 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.322246 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.322393 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.322547 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.322547 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.322825 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.323022 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.323190 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.323343 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.323495 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.323646 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.323806 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.323957 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.324101 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.324244 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.324395 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.324541 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.324693 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.324855 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.325006 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.325156 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.325306 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.325454 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.325615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.325772 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.325923 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.326245 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.326904 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.327108 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.327268 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.327415 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.327565 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.327720 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.327864 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.328022 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.328175 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.328320 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.328470 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.328470 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.328753 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.328753 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.329038 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.329211 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.329363 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.329507 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.329665 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.329817 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.329963 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.330118 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.330262 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.330412 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.330570 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.330721 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.330872 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.331072 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.331233 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.331377 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.331705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.331874 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.332020 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.332186 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.332343 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.332497 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.332724 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.332879 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.333030 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.333175 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.333336 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.333496 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.333648 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.333792 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.333944 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.334587 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.334740 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.334894 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.335078 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.335235 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.335387 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.335540 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.335692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.335856 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.336009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.336184 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.336511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.337454 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.337557 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.337649 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.337735 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.337821 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.337896 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.337975 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.338072 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.338167 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.338247 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.338320 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.338397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.338479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.338560 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.338633 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.338709 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.338787 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.338787 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.338929 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.339200 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.339290 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.339363 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.339363 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.339507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.339590 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.339670 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.339748 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.339820 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.339900 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.339971 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.340041 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.340162 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.340306 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.340441 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.340580 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.340721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.340845 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.340977 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.341106 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.341247 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.341389 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.341531 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.341677 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.341818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.341950 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.342103 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.342685 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.342889 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.343214 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.343430 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.343633 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.343836 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.344026 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.344230 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.344445 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.344651 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.344856 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.345060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.345276 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.345461 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.345675 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.345878 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.346081 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.346291 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.346496 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.346686 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.346920 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.347207 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.347412 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.347624 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.347834 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.349331 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.349496 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.349677 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.350316 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.350496 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.350698 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.350901 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.351073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.351212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.351332 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.351443 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.351560 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.351700 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.351822 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.351982 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.352131 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.352296 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.352455 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.352626 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.352782 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.352949 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.353097 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.353256 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.353414 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.353575 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.353722 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.353871 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.354028 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.354175 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.354344 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.354501 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.354663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.354820 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.354998 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.355160 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:05:14.355324 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.355492 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.355676 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.355826 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.355980 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.356151 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.356304 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.356448 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.356592 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.356742 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.356888 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.357042 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.357194 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.357346 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.357497 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.357641 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.357800 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.357959 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.358123 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.358298 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.358681 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.359020 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.359287 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.359533 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.359707 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.359862 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.360007 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.360160 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.360314 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.360459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.360643 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.360820 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.360966 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.361118 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.361264 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.361406 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.361629 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.361784 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.361941 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.362086 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.362232 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.362384 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.362537 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.362691 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.362837 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.363007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.363156 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.363315 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.363470 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.363625 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.363777 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.363930 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.364082 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.364236 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.364390 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.364542 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.364709 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.364709 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.364983 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.365136 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.365814 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.365973 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.366117 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.366261 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.366416 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.366569 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.366731 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.367032 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.367257 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.367439 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.367630 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.367818 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.367999 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.368178 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.368365 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.368804 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.369158 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.369469 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.369817 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.369978 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.370133 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.370290 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.370453 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.370606 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.370751 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.370901 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.371065 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.371230 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.371376 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.371520 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.371672 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.371825 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.371969 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.372122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.372281 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.372425 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.372575 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.372727 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.372871 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.372871 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.373166 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.373318 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.373470 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.373622 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.373768 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.373925 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.374077 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.374237 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.374393 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.374546 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.374690 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.374851 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.375039 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.375202 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.375355 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.375513 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.375667 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.375819 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.375972 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.376127 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.376292 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.376437 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.376589 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.376734 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.376877 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.377035 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.377187 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.377331 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.377487 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.377639 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.377783 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.377935 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.378098 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.378242 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.378396 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.378548 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.378922 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.379340 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.379596 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.379764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.380022 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.380175 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.380326 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.380470 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.380614 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.380776 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.380984 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.381624 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.381785 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.381964 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.382220 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.382390 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.382537 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.382691 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.382845 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.383025 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.383186 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.383343 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.383499 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.383644 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.383788 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.383938 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.384092 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.384237 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.384381 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.384541 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.384693 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.384845 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.385004 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.385156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.385307 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.385469 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.385615 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.385615 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.385895 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.386040 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.386183 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.386335 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.386479 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.386630 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.386784 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.386938 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.387138 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.387301 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.387455 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.387609 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.387763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.388157 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.388301 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.388454 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.388599 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.388599 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.389127 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.389445 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.389617 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.389855 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.390015 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.390175 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.390435 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.390585 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.390730 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.390874 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.391083 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.391251 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.391397 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.391547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.391700 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.391846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.392606 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.392759 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.392904 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.393057 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.393209 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.393354 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.393496 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.393639 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.393784 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.394245 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.394417 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.394566 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.394723 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.394723 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.395058 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.395219 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.395365 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.395533 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.395727 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.395881 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.396034 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.396179 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.396322 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.396322 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.396628 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.396783 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.396943 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.397087 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.397275 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.397433 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.397577 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.397721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.397880 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.398032 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.398177 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.398320 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.398464 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.398464 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.398772 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.398924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.399345 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.399658 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.399822 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.400090 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.400247 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.400417 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.400657 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.400814 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.400968 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.401125 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.401277 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.401432 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.401583 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.401728 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.401871 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.402028 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.402182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.402334 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.402478 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.402622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.402764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.402917 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.403096 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.403254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.403406 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.403550 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.403707 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.403858 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.404011 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.404156 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.404299 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.404459 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.404632 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.404780 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.404923 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.405073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.405235 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.405235 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.405517 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.405662 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.405806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.405948 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.406091 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.406241 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.406394 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.406546 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.406690 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.406841 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.407010 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.407114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.407390 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.407483 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.407569 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.407649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.407729 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.407812 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.407899 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.407998 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.408079 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.408171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.408270 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.408366 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.408452 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.408669 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.408776 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.408864 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.408956 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.409052 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.409138 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.409245 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.409509 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.409636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.409740 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.409831 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.409925 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.410005 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.410268 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.410371 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.410472 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.410559 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.410670 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.410757 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.410842 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.410925 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.411042 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.411131 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.411214 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.411297 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.411382 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.411516 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.411606 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.411680 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.411752 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.411830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.411902 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.411987 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.412094 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.412181 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.412254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.412325 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.412395 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.412476 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.412556 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.412629 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.412708 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.412788 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.412861 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.412947 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.413028 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.413102 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.413173 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.413251 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.413704 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.413804 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.413895 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.413993 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.414092 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.414186 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.414280 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.414377 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.414464 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.414548 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.414638 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.414731 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.414869 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.414958 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.415116 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.415204 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.415204 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.415363 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.415457 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.415549 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.415631 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.415715 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.415798 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.415891 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.415983 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.416068 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.416160 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.416261 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.416354 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.416438 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.416521 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.416611 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.416702 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.416802 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.416888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.416978 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.417063 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.417152 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.417152 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.417313 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.417399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.417483 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.417565 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.417647 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.417739 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.417838 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.417923 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.417923 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.418088 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.418187 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.418281 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.418373 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.418467 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.418559 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.418651 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.418736 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.418825 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.418909 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.419020 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.419116 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.419208 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.419292 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.419375 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.419473 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.419711 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.419808 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.419890 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.419970 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.420055 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.420146 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.420249 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.420356 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.420449 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.420535 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.420629 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.420720 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.420804 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.420896 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.420983 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.421070 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.421149 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.421241 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.421343 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.421429 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.421521 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.421521 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.421681 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.421764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.421896 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.421991 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.422076 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.422160 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.422243 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.422327 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.422424 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.422517 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.422601 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.422601 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.422768 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.422768 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.422934 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.422934 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.423255 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.423345 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.423437 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.423536 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.423628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.423714 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.423805 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.423890 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.423974 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.424073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.424159 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.424244 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.424331 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.424415 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.424498 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.424590 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.424683 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.424774 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.424895 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.424995 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.425202 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.425297 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.425521 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.425615 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.425836 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.425939 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.426142 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.426317 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.426441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.426532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.426750 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.426842 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.427083 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.427188 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.427395 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.427495 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.428204 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.428306 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.428528 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.428628 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.428835 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.428937 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.429148 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.429248 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.429456 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.429548 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.429978 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.430092 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.430092 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.430266 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.430358 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.430441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.431254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.431355 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.431465 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.431564 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.431651 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.431651 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.431831 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.432066 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.432150 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.432384 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.432468 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.432714 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.432797 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.433030 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.433126 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.433342 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.433437 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.433639 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.433792 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.433944 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.434036 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.434246 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.434329 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.434554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.434683 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.435047 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.435374 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.435688 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.435998 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.436133 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.436314 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.436466 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.436625 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.436793 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.436936 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.437116 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.437254 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.437437 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.437581 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.437773 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.437903 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.438097 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.438205 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.438413 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.438514 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.438727 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.438835 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.440319 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.440461 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.440549 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.440625 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.440729 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.440815 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.440815 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.440982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.441104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.441203 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.441381 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.441494 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.441589 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.441701 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.441795 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.441880 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.441964 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.442059 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.442144 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.442238 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.442330 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.442423 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.442508 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.442592 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.442690 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.442808 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.443016 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.443152 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.443348 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.444067 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.444431 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.444591 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.444757 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.444928 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.445079 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.445223 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.445375 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.445477 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.445563 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.445647 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.445918 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.446036 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.446136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.446217 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.446410 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.446565 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.446733 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.446841 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.447077 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.447174 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.447400 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.447501 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.447709 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.447814 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.448015 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.448129 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.448328 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.448437 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.448641 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.448750 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.448950 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.449041 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.449266 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.449360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.449579 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.449687 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.449892 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.449985 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.450205 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.450310 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.450508 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.450622 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.450816 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.450917 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.451158 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.451254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.451470 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.451608 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.451779 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.451872 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.452091 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.452182 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.452395 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.452488 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.452704 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.452800 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.453011 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.453103 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.453320 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.453630 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.453730 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.453945 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.454045 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.454260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.454361 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.454573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.454688 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.454899 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.455022 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.455245 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.455342 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.455554 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.455649 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.455867 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.455956 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.456194 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.456305 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.456477 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.456579 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.456785 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.456878 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.457185 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.457482 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.457584 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.457790 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.457883 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.458099 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.458201 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.458408 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.458500 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.458730 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.458823 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.459592 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.459713 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.459900 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.459998 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.460206 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.460323 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.460598 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.460707 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.460852 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.461005 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.461176 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.461276 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.461595 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.461700 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.461894 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.461991 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.462197 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.462314 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.462504 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.462613 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.462818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.462923 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.463174 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.463302 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.463486 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.463599 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.463795 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.463899 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.464106 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.464271 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.464434 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.464538 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.464744 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.464854 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.465051 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.465194 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.465371 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.465479 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.465695 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.465811 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.466008 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.466163 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.466324 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.466505 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.466653 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.466824 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.466968 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.467275 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.467408 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.467538 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.467684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.467817 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.467948 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.468115 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.468259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.468426 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.468581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.468747 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.468883 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.469064 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.469208 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.469393 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.469541 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.469740 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.469875 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.470006 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.470126 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.470324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.470473 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.470696 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.470895 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.471062 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.471198 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.471344 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.471483 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.471613 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.471733 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.471872 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.472003 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.472166 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.472311 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.472477 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.472620 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.472782 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.472931 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.473082 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.473245 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.473383 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.473578 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.473723 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.473888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.474034 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.474199 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.474334 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.474515 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.474699 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.475436 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.475599 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.475741 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.475873 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.476068 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.476211 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.476380 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.476526 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.476692 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.476833 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.477000 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.477135 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.477304 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.477444 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.477608 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.477750 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.477916 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.478052 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.478243 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.478386 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.478550 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.478686 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.478875 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.479049 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.479222 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.479356 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.479548 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.479683 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.479929 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.480077 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.480199 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.480337 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.480477 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.480623 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.480840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.481064 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.481205 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.481346 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.481477 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.481609 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.481747 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.481878 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.482017 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.482148 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.482279 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.482409 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.482576 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.482701 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.482844 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.482975 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.483180 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.483313 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.483462 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.483594 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.483756 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.483893 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.484061 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.484204 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.484384 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.484528 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.484689 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.484824 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.485010 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.485145 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.485320 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.485463 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.485625 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.485759 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.485931 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.486068 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.486233 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.486376 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.486574 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.486714 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.486872 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.487049 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.487216 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.487359 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.487531 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.487666 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.487840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.487987 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.488149 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.488291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.488456 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.488591 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.488783 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.488927 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.489092 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.489229 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.489402 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.489543 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.489716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.489849 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.490026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.490170 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.490372 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.490565 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.490779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.491312 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.491462 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.491611 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.491751 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.491883 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.492023 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.492023 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.492279 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.492411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.492551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.492690 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.492833 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.492972 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.493104 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.493234 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.493373 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.493554 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.493687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.493818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.493948 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.494086 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.494218 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.494367 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.494500 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.494675 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.494819 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.495005 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.495157 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.495342 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.495479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.495666 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.495806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.496215 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.496350 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.496548 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.496685 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.496868 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.497013 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.497185 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.497338 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.497506 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.497647 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.497802 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.497953 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.498117 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.498262 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.498432 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.498609 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.498749 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.498881 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.499071 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.499217 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.499386 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.499529 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.499717 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.499851 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.500029 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.500162 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.500343 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.500480 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.500665 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.500800 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.501002 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.501238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.501437 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.501582 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.501715 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.501855 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.501995 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.502134 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.502272 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.502410 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.502543 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.502687 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.502820 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.502950 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.503238 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.503381 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.503527 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.503659 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.503791 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.503921 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.504099 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.504238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.504453 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.504596 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.504773 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.504910 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.505090 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.505225 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.505413 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.505558 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.505728 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.506393 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.506606 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.506836 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.507103 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.507312 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.507525 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.507744 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.507744 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.508176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.508333 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.508474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.508606 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.508745 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.508876 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.509088 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.509231 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.509362 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.509493 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.509623 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.509753 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.509893 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.510026 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.510165 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.510299 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.510438 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.510568 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.510699 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.510829 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.510959 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.511135 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.511354 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.511602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.511738 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.511877 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.512007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.512154 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.512287 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.512432 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.512572 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.512704 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.513081 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.513215 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.513345 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.513485 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.513624 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.513755 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.513894 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.514034 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.514175 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.514308 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.514438 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.514602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.514750 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.514889 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.515214 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.515354 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.515522 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.515664 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.515826 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.515969 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.516136 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.516271 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.516438 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.516581 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.516763 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.516899 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.517068 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.517213 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.517360 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.517493 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.517663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.517813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.517958 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.518088 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.518262 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.518406 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.518566 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.518710 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.518870 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.519061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.519206 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.519338 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.519493 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.519638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.519798 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.519941 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.520102 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.520243 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.520408 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.520550 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.520691 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.520828 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.521023 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.521158 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.521387 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.522086 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.522288 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.522421 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.522560 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.522693 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.522837 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.523031 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.523165 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.523297 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.523428 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.523569 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.523710 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.523842 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.523972 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.524111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.524275 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.524410 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.524583 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.524733 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.524897 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.525040 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.525210 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.525359 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.525523 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.525746 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.525890 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.526081 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.526229 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.526404 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.526539 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.526737 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.526872 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.527085 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.527232 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.527378 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.527507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.527684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.527826 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.527990 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.528140 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.528311 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.528449 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.528619 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.528751 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.528929 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.529076 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.529237 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.529370 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.529547 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.529691 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.529858 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.530102 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.530238 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.530447 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.530582 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.530761 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.530893 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.531093 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.531224 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.531405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.531626 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.531760 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.531906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.532050 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.532183 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.532336 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.532532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.532665 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.532803 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.532956 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.533146 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.533288 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.533434 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.533574 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.533718 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.533850 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.533980 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.534111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.534252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.534412 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.534556 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.534722 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.534857 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.535055 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.535192 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.535369 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.535512 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.535678 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.535826 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.535988 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.536130 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.536282 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.536496 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.536633 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.536761 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.536888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.537026 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.537233 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.537380 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.537579 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.537714 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.537901 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.538117 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.538251 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.538391 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.538537 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.538676 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.538830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.539006 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.539173 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.539322 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.539468 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.539599 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.539786 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.539924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.540094 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.540214 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.540410 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.540537 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.540741 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.540872 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.541060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.541197 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.541371 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.541506 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.541679 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.541819 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.541986 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.542129 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.542292 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.542427 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.542609 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.542730 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.542931 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.543059 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.543262 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.543387 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.543569 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.543677 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.543872 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.543967 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.544182 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.544285 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.544485 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.544580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.544789 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.544883 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.545093 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.545197 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.545395 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.545523 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.545702 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.545852 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.546004 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.546163 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.546311 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.546470 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.546604 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.546767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.546919 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.547107 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.547256 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.547431 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.547575 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.547746 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.547897 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.548038 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.548169 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.548342 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.548487 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.548648 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.548795 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.548953 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.549086 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.549250 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.549383 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.549550 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.549684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.549858 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.550001 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.550167 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.550301 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.550471 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.550607 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.550778 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.550922 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.551101 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.551233 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.551382 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.551522 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.551689 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.551919 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.552074 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.552214 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.552355 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.552486 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.552616 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.552791 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.552991 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.553139 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.553279 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.553419 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.553577 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.553717 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.553859 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.554005 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.554137 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.554274 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.554405 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.554535 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.554704 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.554853 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.555057 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.555195 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.555376 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.555511 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.555682 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.555860 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.556009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.556205 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.556340 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.556460 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.556600 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.556741 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.556919 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.557060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.557229 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.557362 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.557555 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.557689 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.557865 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.557998 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.558174 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.558317 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.558484 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.558617 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.558790 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.558930 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.559124 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.559278 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.559436 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.559579 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.559744 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.559876 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.560057 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.560206 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.560377 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.560511 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.560689 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.560829 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.561015 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.561162 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.561337 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.561478 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.561650 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.561785 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.561964 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.562098 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.562288 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.562420 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.562598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.562731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.562913 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.563150 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.563271 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.563402 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.563541 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.563673 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.563856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.563993 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.564175 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.564310 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.564486 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.564632 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.564774 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 19:05:14.564913 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.565106 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.565427 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.565761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.566092 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.566409 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.566737 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.567096 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.567450 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.567768 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.568116 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.568989 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.569305 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.569644 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.569917 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:05:14.570163 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 19:05:14.627232 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO dbcounter [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] Registered counter for database nova_api Oct 28 19:05:14.632661 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO dbcounter [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] Registered counter for database nova_api Oct 28 19:05:14.648361 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_db.sqlalchemy.engines [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:05:14.653233 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_db.sqlalchemy.engines [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118874) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:05:14.655054 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writer thread running {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:05:14.659965 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writer thread running {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:05:14.711301 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.context [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5dcc3b4c-f46d-4789-b42a-a872c650e37f(cell1) {{(pid=118875) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 19:05:14.715334 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:14.715476 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.context [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5dcc3b4c-f46d-4789-b42a-a872c650e37f(cell1) {{(pid=118874) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 19:05:14.715811 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:14.717387 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:14.718117 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:14.718561 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:14.719366 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:14.719838 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:14.720585 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:14.721404 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:14.722126 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:14.722566 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:14.722672 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO dbcounter [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] Registered counter for database nova_cell0 Oct 28 19:05:14.724624 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:14.726609 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO dbcounter [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] Registered counter for database nova_cell0 Oct 28 19:05:14.726946 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO dbcounter [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] Registered counter for database nova_cell1 Oct 28 19:05:14.730910 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO dbcounter [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] Registered counter for database nova_cell1 Oct 28 19:05:14.735397 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_db.sqlalchemy.engines [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:05:14.737513 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_db.sqlalchemy.engines [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:05:14.739895 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_db.sqlalchemy.engines [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118874) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:05:14.740831 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writer thread running {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:05:14.741262 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_db.sqlalchemy.engines [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118874) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:05:14.747705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writer thread running {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:05:14.883506 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writer thread running {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:05:14.886731 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writer thread running {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:05:14.892545 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO dbcounter [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] Registered counter for database nova_cell0 Oct 28 19:05:14.897869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO dbcounter [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] Registered counter for database nova_cell0 Oct 28 19:05:14.899279 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_db.sqlalchemy.engines [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:05:14.904240 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writer thread running {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:05:14.905463 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_db.sqlalchemy.engines [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118874) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:05:14.910113 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writer thread running {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:05:15.225050 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: WARNING keystonemiddleware.auth_token [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 19:05:15.231057 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: WARNING keystonemiddleware.auth_token [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 19:05:15.232454 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: WARNING keystonemiddleware.auth_token [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 19:05:15.238697 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: WARNING keystonemiddleware.auth_token [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 19:05:15.578559 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: WARNING keystonemiddleware.auth_token [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 19:05:15.585163 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: WARNING keystonemiddleware.auth_token [None req-88ae7f43-7513-4a8d-807c-36b7f2630e00 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 19:05:15.588176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: WARNING keystonemiddleware.auth_token [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 19:05:15.590483 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55810a3ba9c0 pid: 118875 (default app) Oct 28 19:05:15.594233 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: WARNING keystonemiddleware.auth_token [None req-9615d4db-1606-4e2a-b636-bd3494537222 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 19:05:15.600155 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55810a3ba9c0 pid: 118874 (default app) Oct 28 19:05:55.418094 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-30928239-5091-4a4b-a364-c45295f32ab9 tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] Calling method '.version_select at 0x7f9bf77b7a60>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:55.487281 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_api:SELECT=3 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:55.488757 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=3 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:55.489681 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell0:SELECT=3 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:55.491453 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell0:SELECT=3 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:56.485418 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-30928239-5091-4a4b-a364-c45295f32ab9 tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/f098d15c-f325-4bd5-825b-75a3eb31c6db" status: 200 len: 351 microversion: 2.1 time: 1.372542 Oct 28 19:05:56.486010 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 1/1] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Oct 28 19:05:55 2022] GET /compute/v2.1/os-volumes/f098d15c-f325-4bd5-825b-75a3eb31c6db => generated 351 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:05:56.986436 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=3 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:56.988721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=3 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:56.989934 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=3 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:56.990971 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=3 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:57.743570 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-5e0928f6-bb22-4538-adf9-b8e39c7d9ab8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Action: 'create', calling method: .version_select at 0x7f9bf7751ee0>, body: {"keypair": {"name": "tempest-keypair-2095254103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK21EztY4owX2Lc9MzjkZLrKeBcNrrS0tuKDtlDfRU7aSb0MHO83oaXnmCeCJEZWRQ3xyk9dSvG3AGuSTBwHs2o3P07TjxVUKnarwmHAjIwL317dj5IrAxS1jfuorGIxTw=="}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:05:57.811085 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-5e0928f6-bb22-4538-adf9-b8e39c7d9ab8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Getting quotas for project 55bc75ee717c43b7811b0ab11c647f99. Resources: {'key_pairs'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:05:57.822177 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-5e0928f6-bb22-4538-adf9-b8e39c7d9ab8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Getting quotas for user e868bb74b33f467380562aec01a3d3e9 and project 55bc75ee717c43b7811b0ab11c647f99. Resources: {'key_pairs'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:05:57.907525 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-5e0928f6-bb22-4538-adf9-b8e39c7d9ab8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.929251 Oct 28 19:05:57.909163 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 1/2] 10.222.0.58 () {62 vars in 1200 bytes} [Fri Oct 28 19:05:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 935 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 19:05:58.703896 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-1e32f544-6704-4eb9-a0fc-ec517f893998 tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] Calling method '.version_select at 0x7f9bf7609d30>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:58.797813 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-1e32f544-6704-4eb9-a0fc-ec517f893998 tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/fdd93835-ed81-42f7-bea6-826177ca2807" status: 200 len: 350 microversion: 2.1 time: 0.100685 Oct 28 19:05:58.798371 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Oct 28 19:05:58 2022] GET /compute/v2.1/os-volumes/fdd93835-ed81-42f7-bea6-826177ca2807 => generated 350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:00.714765 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-785290ac-61e6-4150-b6b7-a321480c4bfd tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] Calling method '.version_select at 0x7f9bf7564700>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:01.150678 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-785290ac-61e6-4150-b6b7-a321480c4bfd tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/06af5924-8e7e-4a59-9cb2-c00527b59fe9" status: 200 len: 350 microversion: 2.1 time: 0.444232 Oct 28 19:06:01.151544 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Oct 28 19:06:00 2022] GET /compute/v2.1/os-volumes/06af5924-8e7e-4a59-9cb2-c00527b59fe9 => generated 350 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:01.165626 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-464c34ac-ae76-4875-aeeb-36e3f6ce4d12 tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] Calling method '.version_select at 0x7f9bf7609ca0>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:01.372277 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-464c34ac-ae76-4875-aeeb-36e3f6ce4d12 tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.211067 Oct 28 19:06:01.373819 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 3/5] 10.222.0.58 () {58 vars in 1134 bytes} [Fri Oct 28 19:06:01 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:01.391174 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-2031cab5-5c82-4834-967a-db26373b08f4 tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] Calling method '.version_select at 0x7f9bf74e8ee0>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:01.574938 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-2031cab5-5c82-4834-967a-db26373b08f4 tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.188758 Oct 28 19:06:01.575739 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 3/6] 10.222.0.58 () {58 vars in 1149 bytes} [Fri Oct 28 19:06:01 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:01.591021 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-24a5c2bb-9c1b-40ba-a267-46553f9de537 tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] Calling method '.version_select at 0x7f9bf7609c10>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:01.830827 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-24a5c2bb-9c1b-40ba-a267-46553f9de537 tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.243729 Oct 28 19:06:01.832008 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1134 bytes} [Fri Oct 28 19:06:01 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:01.848870 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4702867c-0fd7-4917-931f-3438a9f5811e tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] Calling method '.version_select at 0x7f9bf7564af0>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:01.976345 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-4702867c-0fd7-4917-931f-3438a9f5811e tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.135222 Oct 28 19:06:01.977215 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1167 bytes} [Fri Oct 28 19:06:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:01.991707 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-21c59f5f-f4f2-4f43-8ffa-a4f6e95de2ba tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] Calling method '.version_select at 0x7f9bf756d160>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:02.157943 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-21c59f5f-f4f2-4f43-8ffa-a4f6e95de2ba tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.171119 Oct 28 19:06:02.161730 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 5/9] 10.222.0.58 () {58 vars in 1170 bytes} [Fri Oct 28 19:06:01 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:02.183294 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-6359cb33-7c06-4415-be84-a62f52003710 tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] Calling method '.version_select at 0x7f9bf7502310>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:02.352201 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-6359cb33-7c06-4415-be84-a62f52003710 tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.178609 Oct 28 19:06:02.353180 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 5/10] 10.222.0.58 () {58 vars in 1155 bytes} [Fri Oct 28 19:06:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:02.368485 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-ab580895-f3e8-4616-93e6-faa48437828c tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] Calling method '.version_select at 0x7f9bf756dc10>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:02.591075 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-ab580895-f3e8-4616-93e6-faa48437828c tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.228009 Oct 28 19:06:02.592026 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 6/11] 10.222.0.58 () {58 vars in 1188 bytes} [Fri Oct 28 19:06:02 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:02.610294 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-5527d479-5022-4224-883f-97c1c5f24116 tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] Calling method '.version_select at 0x7f9bf7502a60>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:02.848440 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-5527d479-5022-4224-883f-97c1c5f24116 tempest-VolumesTestJSON-1409884339 tempest-VolumesTestJSON-1409884339-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.243444 Oct 28 19:06:02.849315 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 6/12] 10.222.0.58 () {58 vars in 1155 bytes} [Fri Oct 28 19:06:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:03.619490 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-bff8491e-6759-4208-8018-ae06af6b1f1d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-858443134", "imageRef": "cd92a575-ed0d-417b-b416-3471be3ba100", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76697f1b-3728-40eb-a4e4-fcc03821bebb"}], "security_groups": [{"name": "tempest-securitygroup--650195945"}], "key_name": "tempest-keypair-2095254103", "user_data": "}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:04.359443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.network.neutron [None req-bff8491e-6759-4208-8018-ae06af6b1f1d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] validate_networks() for [('76697f1b-3728-40eb-a4e4-fcc03821bebb', None, None, None, None, None)] {{(pid=118875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:06:08.199877 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-bff8491e-6759-4208-8018-ae06af6b1f1d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Flavor limits 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:06:08.201502 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-bff8491e-6759-4208-8018-ae06af6b1f1d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Image limits 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:06:08.202544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-bff8491e-6759-4208-8018-ae06af6b1f1d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Flavor pref 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:06:08.203989 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-bff8491e-6759-4208-8018-ae06af6b1f1d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Image pref 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:06:08.205067 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-bff8491e-6759-4208-8018-ae06af6b1f1d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:06:08.230421 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=4 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:08.232061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:08.279404 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bff8491e-6759-4208-8018-ae06af6b1f1d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:08.281332 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bff8491e-6759-4208-8018-ae06af6b1f1d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:08.282871 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bff8491e-6759-4208-8018-ae06af6b1f1d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:08.286169 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bff8491e-6759-4208-8018-ae06af6b1f1d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:08.290445 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bff8491e-6759-4208-8018-ae06af6b1f1d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:08.293006 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bff8491e-6759-4208-8018-ae06af6b1f1d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:08.415213 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-bff8491e-6759-4208-8018-ae06af6b1f1d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Getting quotas for project 55bc75ee717c43b7811b0ab11c647f99. Resources: {'ram', 'instances', 'cores'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:06:08.428710 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-bff8491e-6759-4208-8018-ae06af6b1f1d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Getting quotas for user e868bb74b33f467380562aec01a3d3e9 and project 55bc75ee717c43b7811b0ab11c647f99. Resources: {'ram', 'instances', 'cores'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:06:08.448750 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-bff8491e-6759-4208-8018-ae06af6b1f1d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Going to run 1 instances... {{(pid=118875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:06:08.451930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-bff8491e-6759-4208-8018-ae06af6b1f1d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd92a575-ed0d-417b-b416-3471be3ba100',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:06:08.572869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-88e8f734-ed7f-4042-a802-2434f422bd61 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-798838728", "imageRef": "cd92a575-ed0d-417b-b416-3471be3ba100", "flavorRef": "452", "networks": [{"uuid": "304cc74b-f705-4c7d-be0e-91f2eaa12ae6"}]}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:08.648595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-bff8491e-6759-4208-8018-ae06af6b1f1d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 5.034518 Oct 28 19:06:08.662249 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 7/13] 10.222.0.58 () {62 vars in 1188 bytes} [Fri Oct 28 19:06:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 5049 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 19:06:08.673328 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-33b83776-824f-4dfc-a6a6-ad50acf91408 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:08.674278 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-33b83776-824f-4dfc-a6a6-ad50acf91408 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:08.802055 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.network.neutron [None req-88e8f734-ed7f-4042-a802-2434f422bd61 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] validate_networks() for [('304cc74b-f705-4c7d-be0e-91f2eaa12ae6', None, None, None, None, None)] {{(pid=118874) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:06:08.934814 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-33b83776-824f-4dfc-a6a6-ad50acf91408 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:08.959968 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-33b83776-824f-4dfc-a6a6-ad50acf91408 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:08.961814 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-33b83776-824f-4dfc-a6a6-ad50acf91408 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:08.963070 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-33b83776-824f-4dfc-a6a6-ad50acf91408 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1281 microversion: 2.20 time: 0.299329 Oct 28 19:06:08.977604 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 8/14] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:08 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1281 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:06:09.996310 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-681dfc91-f32c-403e-82cb-5893896db927 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:10.000531 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-681dfc91-f32c-403e-82cb-5893896db927 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:10.634346 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-681dfc91-f32c-403e-82cb-5893896db927 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:10.652834 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-681dfc91-f32c-403e-82cb-5893896db927 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:10.657997 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-681dfc91-f32c-403e-82cb-5893896db927 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:10.661843 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-681dfc91-f32c-403e-82cb-5893896db927 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1281 microversion: 2.20 time: 0.673361 Oct 28 19:06:10.678871 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 9/15] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:09 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1281 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:06:11.688239 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-12366806-a61a-4a50-8e08-1916a3f7f73e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:11.688907 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-12366806-a61a-4a50-8e08-1916a3f7f73e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:11.706581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-12366806-a61a-4a50-8e08-1916a3f7f73e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:11.707117 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-12366806-a61a-4a50-8e08-1916a3f7f73e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:11.713036 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-12366806-a61a-4a50-8e08-1916a3f7f73e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:11.715048 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-12366806-a61a-4a50-8e08-1916a3f7f73e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:11.715546 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-12366806-a61a-4a50-8e08-1916a3f7f73e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:11.715999 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-12366806-a61a-4a50-8e08-1916a3f7f73e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:11.875982 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-88e8f734-ed7f-4042-a802-2434f422bd61 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Flavor limits 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:06:11.876526 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-88e8f734-ed7f-4042-a802-2434f422bd61 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Image limits 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:06:11.876866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-88e8f734-ed7f-4042-a802-2434f422bd61 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Flavor pref 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:06:11.877275 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-88e8f734-ed7f-4042-a802-2434f422bd61 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Image pref 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:06:11.877683 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-88e8f734-ed7f-4042-a802-2434f422bd61 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:06:11.938954 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-88e8f734-ed7f-4042-a802-2434f422bd61 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:11.939469 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-88e8f734-ed7f-4042-a802-2434f422bd61 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:11.939903 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-88e8f734-ed7f-4042-a802-2434f422bd61 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:11.940698 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-88e8f734-ed7f-4042-a802-2434f422bd61 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:11.941644 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-88e8f734-ed7f-4042-a802-2434f422bd61 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:11.942068 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-88e8f734-ed7f-4042-a802-2434f422bd61 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:12.080252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-88e8f734-ed7f-4042-a802-2434f422bd61 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Getting quotas for project 67626d51a9484e9c98d0a4758707b896. Resources: {'ram', 'instances', 'cores'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:06:12.099321 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-88e8f734-ed7f-4042-a802-2434f422bd61 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Getting quotas for user 095a332a446b4c6a97257bb7c76f1886 and project 67626d51a9484e9c98d0a4758707b896. Resources: {'ram', 'instances', 'cores'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:06:12.167480 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-88e8f734-ed7f-4042-a802-2434f422bd61 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Going to run 1 instances... {{(pid=118874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:06:12.171854 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-88e8f734-ed7f-4042-a802-2434f422bd61 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd92a575-ed0d-417b-b416-3471be3ba100',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:06:12.295744 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-88e8f734-ed7f-4042-a802-2434f422bd61 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.066754 Oct 28 19:06:12.296717 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 7/16] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Oct 28 19:06:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 4068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:06:12.326203 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-12366806-a61a-4a50-8e08-1916a3f7f73e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:12.394658 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-12366806-a61a-4a50-8e08-1916a3f7f73e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:12.396834 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-12366806-a61a-4a50-8e08-1916a3f7f73e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:12.400379 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-12366806-a61a-4a50-8e08-1916a3f7f73e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1333 microversion: 2.20 time: 0.715957 Oct 28 19:06:12.417110 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 10/17] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:11 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1333 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:06:12.437453 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-f6d504bc-44a5-4590-abaa-e9f545a8e6b3 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:12.438363 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-f6d504bc-44a5-4590-abaa-e9f545a8e6b3 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:12.850516 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-f6d504bc-44a5-4590-abaa-e9f545a8e6b3 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:12.862025 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-f6d504bc-44a5-4590-abaa-e9f545a8e6b3 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1214 microversion: 2.1 time: 0.443671 Oct 28 19:06:12.864935 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 11/18] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:12 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1214 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:13.209600 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-7cf14c7b-9b05-4683-98a8-9ef45137a6d5 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] Action: 'create', calling method: .version_select at 0x7f9bf74314c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-433833660", "metadata": {"Type": "work"}}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-7cf14c7b-9b05-4683-98a8-9ef45137a6d5 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] Request method failure captured: Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 121 Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCgjxNDVkgTSVy9zbwwQxgIMEaK2pC3RN1oZhuPTchL4i1E6GZMrqTO-GZjwaXy1ZW2wfbhNQ7aLbANSiMpn2SRZFa94SIUnzsOv2xx-KPn5kv1crFyZk_qynH7y0F4YKgL1uzKXM8SiuK72d5sQWFpyZLXpA1zY-nfX60SO54cUHdM Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: 7f15987bc1e84bc78bfbb63e323f00f9 Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-VolumesNegativeTest-357479813 Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:06:13.234853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:06:13.236104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:06:13.236104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-VolumesNegativeTest-357479813 Oct 28 19:06:13.236104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: 7f15987bc1e84bc78bfbb63e323f00f9 Oct 28 19:06:13.236104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-VolumesNegativeTest-357479813 Oct 28 19:06:13.236104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-VolumesNegativeTest-357479813-project Oct 28 19:06:13.236104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:06:13.236104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:06:13.236104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: f9826eca2619482c9efd54bd803bb122 Oct 28 19:06:13.236104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-VolumesNegativeTest-357479813-project Oct 28 19:06:13.236104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Oct 28 19:06:13.236104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-433833660", "metadata": {"Type": "work"}}} Oct 28 19:06:13.236104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: Oct 28 19:06:13.236104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-433833660', 'metadata': {'Type': 'work'}}}} Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi '#$%' Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:06:13.238628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:06:13.240240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:06:13.241142 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 19:06:13.241142 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.241142 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-7cf14c7b-9b05-4683-98a8-9ef45137a6d5 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:06:13.241142 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-7cf14c7b-9b05-4683-98a8-9ef45137a6d5 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.940291 Oct 28 19:06:13.248693 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 8/19] 10.222.0.58 () {60 vars in 1156 bytes} [Fri Oct 28 19:06:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 951 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:06:13.249132 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d66e40f1-0625-4da5-98c7-9ff6bb89da4c tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] Action: 'create', calling method: .version_select at 0x7f9bf6b639d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2114168528", "metadata": {"Type": "work"}}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d66e40f1-0625-4da5-98c7-9ff6bb89da4c tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] Request method failure captured: Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept: application/json Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept-Encoding: identity Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Connection: close Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Length: 120 Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Type: application/json Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Host: 10.222.0.58 Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Openstack-System-Scope: None Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: User-Agent: python-urllib3/1.26.12 Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Auth-Token: gAAAAABjXCgjxNDVkgTSVy9zbwwQxgIMEaK2pC3RN1oZhuPTchL4i1E6GZMrqTO-GZjwaXy1ZW2wfbhNQ7aLbANSiMpn2SRZFa94SIUnzsOv2xx-KPn5kv1crFyZk_qynH7y0F4YKgL1uzKXM8SiuK72d5sQWFpyZLXpA1zY-nfX60SO54cUHdM Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Id: None Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Name: None Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Identity-Status: Confirmed Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Is-Admin-Project: True Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Id: default Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Name: Default Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Id: 7f15987bc1e84bc78bfbb63e323f00f9 Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Name: tempest-VolumesNegativeTest-357479813 Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Role: member,reader Oct 28 19:06:13.269595 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Roles: member,reader Oct 28 19:06:13.270620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:06:13.270620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant: tempest-VolumesNegativeTest-357479813 Oct 28 19:06:13.270620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Id: 7f15987bc1e84bc78bfbb63e323f00f9 Oct 28 19:06:13.270620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Name: tempest-VolumesNegativeTest-357479813 Oct 28 19:06:13.270620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User: tempest-VolumesNegativeTest-357479813-project Oct 28 19:06:13.270620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Id: default Oct 28 19:06:13.270620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Name: Default Oct 28 19:06:13.270620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Id: f9826eca2619482c9efd54bd803bb122 Oct 28 19:06:13.270620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Name: tempest-VolumesNegativeTest-357479813-project Oct 28 19:06:13.270620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Oct 28 19:06:13.270620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2114168528", "metadata": {"Type": "work"}}} Oct 28 19:06:13.270620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: method: Oct 28 19:06:13.270620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2114168528', 'metadata': {'Type': 'work'}}}} Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi '0' Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:06:13.271254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:06:13.272236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:06:13.273076 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 19:06:13.273076 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.274682 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d66e40f1-0625-4da5-98c7-9ff6bb89da4c tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:06:13.275769 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d66e40f1-0625-4da5-98c7-9ff6bb89da4c tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.031021 Oct 28 19:06:13.277480 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 12/20] 10.222.0.58 () {60 vars in 1156 bytes} [Fri Oct 28 19:06:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 19:06:13.290696 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-d5a1b9b1-fbef-4caa-a9dc-487d77800669 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] Action: 'create', calling method: .version_select at 0x7f9bf747cf70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1726457309", "metadata": {"Type": "work"}}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-d5a1b9b1-fbef-4caa-a9dc-487d77800669 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] Request method failure captured: Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 119 Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCgjxNDVkgTSVy9zbwwQxgIMEaK2pC3RN1oZhuPTchL4i1E6GZMrqTO-GZjwaXy1ZW2wfbhNQ7aLbANSiMpn2SRZFa94SIUnzsOv2xx-KPn5kv1crFyZk_qynH7y0F4YKgL1uzKXM8SiuK72d5sQWFpyZLXpA1zY-nfX60SO54cUHdM Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: 7f15987bc1e84bc78bfbb63e323f00f9 Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-VolumesNegativeTest-357479813 Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:06:13.303598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:06:13.304649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:06:13.304649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-VolumesNegativeTest-357479813 Oct 28 19:06:13.304649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: 7f15987bc1e84bc78bfbb63e323f00f9 Oct 28 19:06:13.304649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-VolumesNegativeTest-357479813 Oct 28 19:06:13.304649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-VolumesNegativeTest-357479813-project Oct 28 19:06:13.304649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:06:13.304649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:06:13.304649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: f9826eca2619482c9efd54bd803bb122 Oct 28 19:06:13.304649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-VolumesNegativeTest-357479813-project Oct 28 19:06:13.304649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Oct 28 19:06:13.304649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1726457309", "metadata": {"Type": "work"}}} Oct 28 19:06:13.304649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: Oct 28 19:06:13.304649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1726457309', 'metadata': {'Type': 'work'}}}} Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi '' Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:06:13.305252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:06:13.306319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:06:13.307205 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 19:06:13.307205 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.308237 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-d5a1b9b1-fbef-4caa-a9dc-487d77800669 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:06:13.323270 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-d5a1b9b1-fbef-4caa-a9dc-487d77800669 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026299 Oct 28 19:06:13.323806 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 9/21] 10.222.0.58 () {60 vars in 1156 bytes} [Fri Oct 28 19:06:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:06:13.339379 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-7dc5fc86-213b-4be8-8cbd-d62f9d0cfe9c tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] Calling method '.version_select at 0x7f9bf6b72ca0>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:13.467874 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-32ee60b6-f054-4c68-b774-eeca763b7c9d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:13.473136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-32ee60b6-f054-4c68-b774-eeca763b7c9d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:13.497264 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.wsgi [None req-7dc5fc86-213b-4be8-8cbd-d62f9d0cfe9c tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] HTTP exception thrown: Volume tempest-invalid-1406417769 could not be found. Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-7dc5fc86-213b-4be8-8cbd-d62f9d0cfe9c tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] Request method failure captured: Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1406417769 HTTP/1.1 Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept: application/json Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept-Encoding: identity Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Connection: close Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Length: 0 Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Type: application/json Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Host: 10.222.0.58 Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Openstack-System-Scope: None Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: User-Agent: python-urllib3/1.26.12 Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Auth-Token: gAAAAABjXCgjxNDVkgTSVy9zbwwQxgIMEaK2pC3RN1oZhuPTchL4i1E6GZMrqTO-GZjwaXy1ZW2wfbhNQ7aLbANSiMpn2SRZFa94SIUnzsOv2xx-KPn5kv1crFyZk_qynH7y0F4YKgL1uzKXM8SiuK72d5sQWFpyZLXpA1zY-nfX60SO54cUHdM Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Id: None Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Name: None Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Identity-Status: Confirmed Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Is-Admin-Project: True Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Id: default Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Name: Default Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Id: 7f15987bc1e84bc78bfbb63e323f00f9 Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Name: tempest-VolumesNegativeTest-357479813 Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Role: member,reader Oct 28 19:06:13.505341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Roles: member,reader Oct 28 19:06:13.506635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:06:13.506635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant: tempest-VolumesNegativeTest-357479813 Oct 28 19:06:13.506635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Id: 7f15987bc1e84bc78bfbb63e323f00f9 Oct 28 19:06:13.506635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Name: tempest-VolumesNegativeTest-357479813 Oct 28 19:06:13.506635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User: tempest-VolumesNegativeTest-357479813-project Oct 28 19:06:13.506635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Id: default Oct 28 19:06:13.506635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Name: Default Oct 28 19:06:13.506635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Id: f9826eca2619482c9efd54bd803bb122 Oct 28 19:06:13.506635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Name: tempest-VolumesNegativeTest-357479813-project Oct 28 19:06:13.506635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: method: Oct 28 19:06:13.506635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: exception: Volume tempest-invalid-1406417769 could not be found. Oct 28 19:06:13.506635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: action_args: {'id': 'tempest-invalid-1406417769'} Oct 28 19:06:13.506635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1406417769 could not be found. (HTTP 404) (Request-ID: req-07623627-29bf-451f-8a26-d163c84faa8d) Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:13.507399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 19:06:13.508551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1406417769 could not be found. Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:06:13.509662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1406417769 could not be found. Oct 28 19:06:13.512815 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.512815 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:13.512815 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.512815 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:13.512815 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:13.512815 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:13.512815 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:06:13.512815 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:06:13.512815 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1406417769 could not be found. Oct 28 19:06:13.512815 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:06:13.515563 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-7dc5fc86-213b-4be8-8cbd-d62f9d0cfe9c tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] Returning 404 to user: Volume tempest-invalid-1406417769 could not be found. {{(pid=118875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:06:13.519291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-7dc5fc86-213b-4be8-8cbd-d62f9d0cfe9c tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1406417769" status: 404 len: 99 microversion: 2.1 time: 0.186856 Oct 28 19:06:13.520577 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 13/22] 10.222.0.58 () {58 vars in 1218 bytes} [Fri Oct 28 19:06:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1406417769 => generated 99 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:06:13.534958 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32ee60b6-f054-4c68-b774-eeca763b7c9d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:13.537507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32ee60b6-f054-4c68-b774-eeca763b7c9d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:13.537961 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32ee60b6-f054-4c68-b774-eeca763b7c9d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:13.538677 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32ee60b6-f054-4c68-b774-eeca763b7c9d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:13.546553 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32ee60b6-f054-4c68-b774-eeca763b7c9d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:13.548678 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32ee60b6-f054-4c68-b774-eeca763b7c9d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:14.041005 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-56ecd4a5-80db-4b83-9b41-ac7f8cb0d299 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Action: 'create', calling method: .version_select at 0x7f9bf6b72e50>, body: {"keypair": {"name": "tempest-keypair-1647481399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEvz2vlD/s0L1nu6pyB4j/v4Kx1GD99eI8M67zqyDsZqEQeSHBkqe15A8j9Sm9UFyMP7a9rtf0dyaxZ4X7GE/rjBqHy0jU/mheY9u4w7ktxUcTZgANVNm+Ns1xi7h/I3A=="}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:14.095882 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-32ee60b6-f054-4c68-b774-eeca763b7c9d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:14.119306 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-32ee60b6-f054-4c68-b774-eeca763b7c9d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:14.122652 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-32ee60b6-f054-4c68-b774-eeca763b7c9d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:14.124629 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-32ee60b6-f054-4c68-b774-eeca763b7c9d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1339 microversion: 2.20 time: 0.674319 Oct 28 19:06:14.125541 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 10/23] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:13 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1339 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:06:14.130354 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-56ecd4a5-80db-4b83-9b41-ac7f8cb0d299 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Getting quotas for project 526aaf60dd6c42808951c5f48f8fabd2. Resources: {'key_pairs'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:06:14.131262 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-328956bf-92ae-478e-8c68-24964c2952a6 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004530 Oct 28 19:06:14.131759 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 11/24] 10.222.0.58 () {58 vars in 1140 bytes} [Fri Oct 28 19:06:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 19:06:14.144050 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-7fb4c9f7-0bae-466d-8ea5-007f7e3a0efb tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:14.146481 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-7fb4c9f7-0bae-466d-8ea5-007f7e3a0efb tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:14.152425 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-56ecd4a5-80db-4b83-9b41-ac7f8cb0d299 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Getting quotas for user a25c8936b368477880f429e818a321fa and project 526aaf60dd6c42808951c5f48f8fabd2. Resources: {'key_pairs'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:06:14.274714 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-56ecd4a5-80db-4b83-9b41-ac7f8cb0d299 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.752656 Oct 28 19:06:14.275922 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 14/25] 10.222.0.58 () {60 vars in 1159 bytes} [Fri Oct 28 19:06:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:14.305285 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-7fb4c9f7-0bae-466d-8ea5-007f7e3a0efb tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:14.330475 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-7fb4c9f7-0bae-466d-8ea5-007f7e3a0efb tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1214 microversion: 2.1 time: 0.193748 Oct 28 19:06:14.333151 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 12/26] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:14 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1214 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:14.341893 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-080fc5e5-be8f-47ec-9d1b-daa4549e7e32 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006490 Oct 28 19:06:14.358328 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 13/27] 10.222.0.58 () {58 vars in 1137 bytes} [Fri Oct 28 19:06:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 19:06:14.367762 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a495b730-0b4d-450a-a5d7-4f2ba8fc6281 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] Calling method '.version_select at 0x7f9bf6b21af0>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:14.428686 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-a495b730-0b4d-450a-a5d7-4f2ba8fc6281 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] HTTP exception thrown: Volume facd9ded-214c-4d93-b5fe-38ee3c17daab could not be found. Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a495b730-0b4d-450a-a5d7-4f2ba8fc6281 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] Request method failure captured: Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: DELETE /compute/v2.1/os-volumes/facd9ded-214c-4d93-b5fe-38ee3c17daab HTTP/1.1 Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCgjxNDVkgTSVy9zbwwQxgIMEaK2pC3RN1oZhuPTchL4i1E6GZMrqTO-GZjwaXy1ZW2wfbhNQ7aLbANSiMpn2SRZFa94SIUnzsOv2xx-KPn5kv1crFyZk_qynH7y0F4YKgL1uzKXM8SiuK72d5sQWFpyZLXpA1zY-nfX60SO54cUHdM Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: 7f15987bc1e84bc78bfbb63e323f00f9 Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-VolumesNegativeTest-357479813 Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:06:14.432761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:06:14.433866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:06:14.433866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-VolumesNegativeTest-357479813 Oct 28 19:06:14.433866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: 7f15987bc1e84bc78bfbb63e323f00f9 Oct 28 19:06:14.433866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-VolumesNegativeTest-357479813 Oct 28 19:06:14.433866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-VolumesNegativeTest-357479813-project Oct 28 19:06:14.433866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:06:14.433866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:06:14.433866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: f9826eca2619482c9efd54bd803bb122 Oct 28 19:06:14.433866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-VolumesNegativeTest-357479813-project Oct 28 19:06:14.433866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: Oct 28 19:06:14.433866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Volume facd9ded-214c-4d93-b5fe-38ee3c17daab could not be found. Oct 28 19:06:14.433866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'id': 'facd9ded-214c-4d93-b5fe-38ee3c17daab'} Oct 28 19:06:14.433866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume facd9ded-214c-4d93-b5fe-38ee3c17daab could not be found. (HTTP 404) (Request-ID: req-8c6de943-b16f-4501-8ecf-5c8f26e741e9) Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:14.434474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 19:06:14.435414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume facd9ded-214c-4d93-b5fe-38ee3c17daab could not be found. Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 19:06:14.437156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:06:14.438960 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume facd9ded-214c-4d93-b5fe-38ee3c17daab could not be found. Oct 28 19:06:14.438960 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:14.438960 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:14.438960 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:14.438960 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:14.438960 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:14.438960 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:14.438960 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:06:14.438960 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:06:14.438960 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume facd9ded-214c-4d93-b5fe-38ee3c17daab could not be found. Oct 28 19:06:14.438960 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:14.443269 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a495b730-0b4d-450a-a5d7-4f2ba8fc6281 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] Returning 404 to user: Volume facd9ded-214c-4d93-b5fe-38ee3c17daab could not be found. {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:06:14.445218 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-a495b730-0b4d-450a-a5d7-4f2ba8fc6281 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/facd9ded-214c-4d93-b5fe-38ee3c17daab" status: 404 len: 109 microversion: 2.1 time: 0.084942 Oct 28 19:06:14.447441 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 14/28] 10.222.0.58 () {58 vars in 1248 bytes} [Fri Oct 28 19:06:14 2022] DELETE /compute/v2.1/os-volumes/facd9ded-214c-4d93-b5fe-38ee3c17daab => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:06:14.475331 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-bc2bb736-d4e3-4e86-9a53-c095cc984049 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] Calling method '.version_select at 0x7f9bf74364c0>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:14.527871 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-bc2bb736-d4e3-4e86-9a53-c095cc984049 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] HTTP exception thrown: Volume 02d77f1d-48d5-4189-9097-a960f5788503 could not be found. Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-bc2bb736-d4e3-4e86-9a53-c095cc984049 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] Request method failure captured: Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: GET /compute/v2.1/os-volumes/02d77f1d-48d5-4189-9097-a960f5788503 HTTP/1.1 Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCgjxNDVkgTSVy9zbwwQxgIMEaK2pC3RN1oZhuPTchL4i1E6GZMrqTO-GZjwaXy1ZW2wfbhNQ7aLbANSiMpn2SRZFa94SIUnzsOv2xx-KPn5kv1crFyZk_qynH7y0F4YKgL1uzKXM8SiuK72d5sQWFpyZLXpA1zY-nfX60SO54cUHdM Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: 7f15987bc1e84bc78bfbb63e323f00f9 Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-VolumesNegativeTest-357479813 Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:06:14.530007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:06:14.531312 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7f15987bc1e84bc78bfbb63e323f00f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:06:14.531312 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-VolumesNegativeTest-357479813 Oct 28 19:06:14.531312 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: 7f15987bc1e84bc78bfbb63e323f00f9 Oct 28 19:06:14.531312 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-VolumesNegativeTest-357479813 Oct 28 19:06:14.531312 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-VolumesNegativeTest-357479813-project Oct 28 19:06:14.531312 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:06:14.531312 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:06:14.531312 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: f9826eca2619482c9efd54bd803bb122 Oct 28 19:06:14.531312 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-VolumesNegativeTest-357479813-project Oct 28 19:06:14.531312 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: Oct 28 19:06:14.531312 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Volume 02d77f1d-48d5-4189-9097-a960f5788503 could not be found. Oct 28 19:06:14.531312 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'id': '02d77f1d-48d5-4189-9097-a960f5788503'} Oct 28 19:06:14.531312 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02d77f1d-48d5-4189-9097-a960f5788503 could not be found. (HTTP 404) (Request-ID: req-d43df339-8796-4f5d-8dc0-b172dc3164a4) Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:14.532061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:06:14.533153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02d77f1d-48d5-4189-9097-a960f5788503 could not be found. Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 19:06:14.534266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:06:14.535326 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02d77f1d-48d5-4189-9097-a960f5788503 could not be found. Oct 28 19:06:14.535326 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:14.535326 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:14.535326 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:14.535326 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:14.535326 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:14.535326 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:14.535326 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:06:14.535326 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:06:14.535326 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02d77f1d-48d5-4189-9097-a960f5788503 could not be found. Oct 28 19:06:14.535326 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:06:14.535326 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-bc2bb736-d4e3-4e86-9a53-c095cc984049 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] Returning 404 to user: Volume 02d77f1d-48d5-4189-9097-a960f5788503 could not be found. {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:06:14.535326 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-bc2bb736-d4e3-4e86-9a53-c095cc984049 tempest-VolumesNegativeTest-357479813 tempest-VolumesNegativeTest-357479813-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/02d77f1d-48d5-4189-9097-a960f5788503" status: 404 len: 109 microversion: 2.1 time: 0.080167 Oct 28 19:06:14.535326 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 15/29] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Oct 28 19:06:14 2022] GET /compute/v2.1/os-volumes/02d77f1d-48d5-4189-9097-a960f5788503 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:06:14.833872 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-20045dd3-6804-4010-884e-183545fade49 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1731339852", "imageRef": "cd92a575-ed0d-417b-b416-3471be3ba100", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:14.959136 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.network.neutron [None req-20045dd3-6804-4010-884e-183545fade49 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] validate_networks() for [('9c885fca-8f30-433d-8742-508f4f0d3d38', None, None, None, None, None)] {{(pid=118875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:06:15.150594 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f21de3f6-525f-40b3-ab51-f4f5cdbf2d18 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:15.151463 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f21de3f6-525f-40b3-ab51-f4f5cdbf2d18 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:15.173397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f21de3f6-525f-40b3-ab51-f4f5cdbf2d18 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:15.176337 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f21de3f6-525f-40b3-ab51-f4f5cdbf2d18 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:15.177143 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f21de3f6-525f-40b3-ab51-f4f5cdbf2d18 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:15.182411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f21de3f6-525f-40b3-ab51-f4f5cdbf2d18 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:15.186641 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f21de3f6-525f-40b3-ab51-f4f5cdbf2d18 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:15.191412 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f21de3f6-525f-40b3-ab51-f4f5cdbf2d18 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:15.537856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f21de3f6-525f-40b3-ab51-f4f5cdbf2d18 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:15.554622 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f21de3f6-525f-40b3-ab51-f4f5cdbf2d18 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:15.557109 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f21de3f6-525f-40b3-ab51-f4f5cdbf2d18 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:15.560957 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f21de3f6-525f-40b3-ab51-f4f5cdbf2d18 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1339 microversion: 2.20 time: 0.414934 Oct 28 19:06:15.574073 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 16/30] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:15 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1339 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:06:15.592680 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-26e99597-5f6c-4da8-b5a0-7dd7ed87d14f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:15.595489 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-26e99597-5f6c-4da8-b5a0-7dd7ed87d14f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:15.630339 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-26e99597-5f6c-4da8-b5a0-7dd7ed87d14f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:15.633657 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-26e99597-5f6c-4da8-b5a0-7dd7ed87d14f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:15.634315 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-26e99597-5f6c-4da8-b5a0-7dd7ed87d14f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:15.642280 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-26e99597-5f6c-4da8-b5a0-7dd7ed87d14f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:15.652529 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-26e99597-5f6c-4da8-b5a0-7dd7ed87d14f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:15.654509 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-26e99597-5f6c-4da8-b5a0-7dd7ed87d14f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:16.139341 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-26e99597-5f6c-4da8-b5a0-7dd7ed87d14f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:16.155413 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-26e99597-5f6c-4da8-b5a0-7dd7ed87d14f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1266 microversion: 2.1 time: 0.579880 Oct 28 19:06:16.165757 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 17/31] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:15 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1266 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:16.593131 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-93151ac1-5478-4e92-997f-2c31b0578fdd tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:16.593838 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-93151ac1-5478-4e92-997f-2c31b0578fdd tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:16.615039 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-93151ac1-5478-4e92-997f-2c31b0578fdd tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:16.615628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-93151ac1-5478-4e92-997f-2c31b0578fdd tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:16.616078 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-93151ac1-5478-4e92-997f-2c31b0578fdd tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:16.616813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-93151ac1-5478-4e92-997f-2c31b0578fdd tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:16.617268 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-93151ac1-5478-4e92-997f-2c31b0578fdd tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:16.617695 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-93151ac1-5478-4e92-997f-2c31b0578fdd tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:17.236340 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-93151ac1-5478-4e92-997f-2c31b0578fdd tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:17.249717 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-93151ac1-5478-4e92-997f-2c31b0578fdd tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:17.260180 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-93151ac1-5478-4e92-997f-2c31b0578fdd tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:17.263256 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-93151ac1-5478-4e92-997f-2c31b0578fdd tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1339 microversion: 2.20 time: 0.674664 Oct 28 19:06:17.268368 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 18/32] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:16 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1339 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:06:17.285329 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-61f58546-3b76-4b68-98ff-8be60562ef10 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:17.288357 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-61f58546-3b76-4b68-98ff-8be60562ef10 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:17.325231 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-61f58546-3b76-4b68-98ff-8be60562ef10 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:17.326174 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-61f58546-3b76-4b68-98ff-8be60562ef10 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:17.328622 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-61f58546-3b76-4b68-98ff-8be60562ef10 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:17.329831 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-61f58546-3b76-4b68-98ff-8be60562ef10 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:17.330618 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-61f58546-3b76-4b68-98ff-8be60562ef10 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:17.333899 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-61f58546-3b76-4b68-98ff-8be60562ef10 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:17.572011 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-61f58546-3b76-4b68-98ff-8be60562ef10 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:17.583944 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-61f58546-3b76-4b68-98ff-8be60562ef10 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1272 microversion: 2.1 time: 0.314027 Oct 28 19:06:17.584843 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 19/33] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:17 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1272 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:17.658684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-20045dd3-6804-4010-884e-183545fade49 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Flavor limits 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:06:17.661185 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-20045dd3-6804-4010-884e-183545fade49 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Image limits 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:06:17.662261 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-20045dd3-6804-4010-884e-183545fade49 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Flavor pref 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:06:17.663109 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-20045dd3-6804-4010-884e-183545fade49 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Image pref 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:06:17.663955 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-20045dd3-6804-4010-884e-183545fade49 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:06:17.684594 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-20045dd3-6804-4010-884e-183545fade49 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:17.687117 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-20045dd3-6804-4010-884e-183545fade49 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:17.689186 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-20045dd3-6804-4010-884e-183545fade49 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:17.692020 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-20045dd3-6804-4010-884e-183545fade49 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:17.692816 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-20045dd3-6804-4010-884e-183545fade49 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:17.695160 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-20045dd3-6804-4010-884e-183545fade49 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:17.850999 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-20045dd3-6804-4010-884e-183545fade49 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Getting quotas for project 4f6c133d9594455182ac1b9ce13df65c. Resources: {'ram', 'instances', 'cores'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:06:17.866906 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-20045dd3-6804-4010-884e-183545fade49 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Getting quotas for user c8ca34fc5c5743d0b5e3f4f97ae285e0 and project 4f6c133d9594455182ac1b9ce13df65c. Resources: {'ram', 'instances', 'cores'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:06:17.922479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-20045dd3-6804-4010-884e-183545fade49 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Going to run 1 instances... {{(pid=118875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:06:17.925289 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-20045dd3-6804-4010-884e-183545fade49 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd92a575-ed0d-417b-b416-3471be3ba100',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:06:18.079336 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-20045dd3-6804-4010-884e-183545fade49 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.800029 Oct 28 19:06:18.080432 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 15/34] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Oct 28 19:06:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 3804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:06:18.092913 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-b672d2d3-015f-4df5-a94d-8db3574eab6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:18.093699 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-b672d2d3-015f-4df5-a94d-8db3574eab6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:18.296170 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-dac91a5d-c837-4699-bca9-720afe82a1dc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:18.296787 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-dac91a5d-c837-4699-bca9-720afe82a1dc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:18.305384 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-dac91a5d-c837-4699-bca9-720afe82a1dc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:18.312866 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-dac91a5d-c837-4699-bca9-720afe82a1dc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:18.314071 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-dac91a5d-c837-4699-bca9-720afe82a1dc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:18.318887 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-dac91a5d-c837-4699-bca9-720afe82a1dc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:18.319552 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-dac91a5d-c837-4699-bca9-720afe82a1dc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:18.324862 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-dac91a5d-c837-4699-bca9-720afe82a1dc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:18.680996 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-b672d2d3-015f-4df5-a94d-8db3574eab6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:18.689859 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-b672d2d3-015f-4df5-a94d-8db3574eab6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1222 microversion: 2.1 time: 0.600894 Oct 28 19:06:18.695839 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 20/35] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:18 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1222 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:18.711581 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f03a4be5-5091-49f4-ab0c-96fcd4cce6f7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:18.734288 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f03a4be5-5091-49f4-ab0c-96fcd4cce6f7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:18.766463 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f03a4be5-5091-49f4-ab0c-96fcd4cce6f7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:18.771614 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f03a4be5-5091-49f4-ab0c-96fcd4cce6f7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:18.772275 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f03a4be5-5091-49f4-ab0c-96fcd4cce6f7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:18.775069 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f03a4be5-5091-49f4-ab0c-96fcd4cce6f7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:18.778355 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f03a4be5-5091-49f4-ab0c-96fcd4cce6f7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:18.778945 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f03a4be5-5091-49f4-ab0c-96fcd4cce6f7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:18.932802 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-dac91a5d-c837-4699-bca9-720afe82a1dc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:18.951856 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-dac91a5d-c837-4699-bca9-720afe82a1dc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:18.962314 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-dac91a5d-c837-4699-bca9-720afe82a1dc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:18.966955 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-dac91a5d-c837-4699-bca9-720afe82a1dc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1406 microversion: 2.20 time: 0.673256 Oct 28 19:06:18.977107 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 16/36] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:18 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1406 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:06:19.063703 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f03a4be5-5091-49f4-ab0c-96fcd4cce6f7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:19.084588 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f03a4be5-5091-49f4-ab0c-96fcd4cce6f7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1272 microversion: 2.1 time: 0.386020 Oct 28 19:06:19.085103 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 21/37] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:18 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1272 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:19.111201 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-a3250c61-c5d8-4856-b077-00148ee9b372 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1797026216", "imageRef": "cd92a575-ed0d-417b-b416-3471be3ba100", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:19.299061 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.network.neutron [None req-a3250c61-c5d8-4856-b077-00148ee9b372 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] validate_networks() for [('9c885fca-8f30-433d-8742-508f4f0d3d38', None, None, None, None, None)] {{(pid=118875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:06:20.006360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-89a4314c-b37c-4d42-aa61-f08db8bd69f3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:20.007389 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-89a4314c-b37c-4d42-aa61-f08db8bd69f3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:20.039020 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-89a4314c-b37c-4d42-aa61-f08db8bd69f3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:20.039577 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-89a4314c-b37c-4d42-aa61-f08db8bd69f3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:20.040050 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-89a4314c-b37c-4d42-aa61-f08db8bd69f3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:20.040788 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-89a4314c-b37c-4d42-aa61-f08db8bd69f3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:20.041253 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-89a4314c-b37c-4d42-aa61-f08db8bd69f3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:20.041685 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-89a4314c-b37c-4d42-aa61-f08db8bd69f3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:20.957670 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-89a4314c-b37c-4d42-aa61-f08db8bd69f3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:20.978855 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-89a4314c-b37c-4d42-aa61-f08db8bd69f3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:20.981729 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-89a4314c-b37c-4d42-aa61-f08db8bd69f3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:20.989865 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-89a4314c-b37c-4d42-aa61-f08db8bd69f3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1406 microversion: 2.20 time: 0.988956 Oct 28 19:06:20.992899 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 22/38] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:19 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1406 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:06:21.010714 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-bc8b1dba-2e87-4959-aa3a-5cf1940c0dd0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:21.014506 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-bc8b1dba-2e87-4959-aa3a-5cf1940c0dd0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:21.031479 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bc8b1dba-2e87-4959-aa3a-5cf1940c0dd0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:21.037654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bc8b1dba-2e87-4959-aa3a-5cf1940c0dd0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:21.038321 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bc8b1dba-2e87-4959-aa3a-5cf1940c0dd0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:21.039381 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bc8b1dba-2e87-4959-aa3a-5cf1940c0dd0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:21.040167 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bc8b1dba-2e87-4959-aa3a-5cf1940c0dd0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:21.042043 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bc8b1dba-2e87-4959-aa3a-5cf1940c0dd0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:21.198101 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-a3250c61-c5d8-4856-b077-00148ee9b372 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Flavor limits 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:06:21.199148 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-a3250c61-c5d8-4856-b077-00148ee9b372 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Image limits 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:06:21.199795 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-a3250c61-c5d8-4856-b077-00148ee9b372 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Flavor pref 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:06:21.200361 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-a3250c61-c5d8-4856-b077-00148ee9b372 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Image pref 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:06:21.200928 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-a3250c61-c5d8-4856-b077-00148ee9b372 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:06:21.226289 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a3250c61-c5d8-4856-b077-00148ee9b372 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:21.231471 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a3250c61-c5d8-4856-b077-00148ee9b372 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:21.232168 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a3250c61-c5d8-4856-b077-00148ee9b372 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:21.233196 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a3250c61-c5d8-4856-b077-00148ee9b372 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:21.233872 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a3250c61-c5d8-4856-b077-00148ee9b372 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:21.234514 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a3250c61-c5d8-4856-b077-00148ee9b372 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:21.305463 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-a3250c61-c5d8-4856-b077-00148ee9b372 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Getting quotas for project 4f6c133d9594455182ac1b9ce13df65c. Resources: {'ram', 'instances', 'cores'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:06:21.312715 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-a3250c61-c5d8-4856-b077-00148ee9b372 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Getting quotas for user c8ca34fc5c5743d0b5e3f4f97ae285e0 and project 4f6c133d9594455182ac1b9ce13df65c. Resources: {'ram', 'instances', 'cores'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:06:21.356138 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-bc8b1dba-2e87-4959-aa3a-5cf1940c0dd0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:21.378434 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-bc8b1dba-2e87-4959-aa3a-5cf1940c0dd0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1272 microversion: 2.1 time: 0.379806 Oct 28 19:06:21.390555 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-a3250c61-c5d8-4856-b077-00148ee9b372 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Going to run 1 instances... {{(pid=118875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:06:21.408483 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 23/39] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:20 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1272 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:21.421921 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-a3250c61-c5d8-4856-b077-00148ee9b372 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd92a575-ed0d-417b-b416-3471be3ba100',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:06:21.655219 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-a3250c61-c5d8-4856-b077-00148ee9b372 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.549662 Oct 28 19:06:21.665008 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 17/40] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Oct 28 19:06:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 2562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:06:21.684375 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-146604e3-c9da-4df1-95b7-4fa012092078 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:21.688640 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-146604e3-c9da-4df1-95b7-4fa012092078 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:22.020854 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-1c895033-8ad6-4470-a1c2-3affa29e2117 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:22.021851 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-1c895033-8ad6-4470-a1c2-3affa29e2117 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:22.034591 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=2 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:22.049747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1c895033-8ad6-4470-a1c2-3affa29e2117 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:22.050287 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1c895033-8ad6-4470-a1c2-3affa29e2117 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:22.050665 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1c895033-8ad6-4470-a1c2-3affa29e2117 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:22.059727 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1c895033-8ad6-4470-a1c2-3affa29e2117 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:22.060981 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1c895033-8ad6-4470-a1c2-3affa29e2117 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:22.063227 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1c895033-8ad6-4470-a1c2-3affa29e2117 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:22.463695 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-146604e3-c9da-4df1-95b7-4fa012092078 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:22.490970 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-146604e3-c9da-4df1-95b7-4fa012092078 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1222 microversion: 2.1 time: 0.819837 Oct 28 19:06:22.497378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 24/41] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:21 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1222 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:22.517774 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-9b42b092-9849-485c-ac21-ffb278f0b216 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:22.521375 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-9b42b092-9849-485c-ac21-ffb278f0b216 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:22.551692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9b42b092-9849-485c-ac21-ffb278f0b216 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:22.555146 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9b42b092-9849-485c-ac21-ffb278f0b216 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:22.556066 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9b42b092-9849-485c-ac21-ffb278f0b216 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:22.558499 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9b42b092-9849-485c-ac21-ffb278f0b216 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:22.559185 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9b42b092-9849-485c-ac21-ffb278f0b216 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:22.560675 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9b42b092-9849-485c-ac21-ffb278f0b216 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:22.884587 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1c895033-8ad6-4470-a1c2-3affa29e2117 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:22.905696 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1c895033-8ad6-4470-a1c2-3affa29e2117 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:22.907215 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1c895033-8ad6-4470-a1c2-3affa29e2117 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:22.918809 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-1c895033-8ad6-4470-a1c2-3affa29e2117 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1406 microversion: 2.20 time: 0.897582 Oct 28 19:06:22.920258 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 18/42] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:22 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1406 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:06:22.942767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-9b42b092-9849-485c-ac21-ffb278f0b216 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:22.956530 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-9b42b092-9849-485c-ac21-ffb278f0b216 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1272 microversion: 2.1 time: 0.455747 Oct 28 19:06:22.976965 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 25/43] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:22 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1272 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:23.534847 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b569ea0b-97f7-4e37-b542-e4b0a82114c4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:23.535505 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b569ea0b-97f7-4e37-b542-e4b0a82114c4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:23.601029 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b569ea0b-97f7-4e37-b542-e4b0a82114c4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:23.601551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b569ea0b-97f7-4e37-b542-e4b0a82114c4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:23.602004 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b569ea0b-97f7-4e37-b542-e4b0a82114c4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:23.602734 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b569ea0b-97f7-4e37-b542-e4b0a82114c4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:23.603235 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b569ea0b-97f7-4e37-b542-e4b0a82114c4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:23.618242 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b569ea0b-97f7-4e37-b542-e4b0a82114c4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:23.927311 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b569ea0b-97f7-4e37-b542-e4b0a82114c4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:23.947862 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-32e1c246-7090-43bc-9dfe-ef10a5085fac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:23.949482 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-32e1c246-7090-43bc-9dfe-ef10a5085fac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:23.958704 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32e1c246-7090-43bc-9dfe-ef10a5085fac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:23.970583 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32e1c246-7090-43bc-9dfe-ef10a5085fac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:23.972635 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32e1c246-7090-43bc-9dfe-ef10a5085fac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:23.977485 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32e1c246-7090-43bc-9dfe-ef10a5085fac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:23.978912 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32e1c246-7090-43bc-9dfe-ef10a5085fac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:23.981379 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32e1c246-7090-43bc-9dfe-ef10a5085fac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:23.991541 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b569ea0b-97f7-4e37-b542-e4b0a82114c4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1274 microversion: 2.1 time: 0.481613 Oct 28 19:06:23.996136 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 19/44] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:23 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1274 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:24.014466 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-9f96c1e2-7a4d-477a-a62c-778f439da7c7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:24.015118 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-9f96c1e2-7a4d-477a-a62c-778f439da7c7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:24.031799 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9f96c1e2-7a4d-477a-a62c-778f439da7c7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:24.036043 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9f96c1e2-7a4d-477a-a62c-778f439da7c7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:24.036699 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9f96c1e2-7a4d-477a-a62c-778f439da7c7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:24.037597 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9f96c1e2-7a4d-477a-a62c-778f439da7c7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:24.046875 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9f96c1e2-7a4d-477a-a62c-778f439da7c7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:24.049230 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9f96c1e2-7a4d-477a-a62c-778f439da7c7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:25.244864 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-32e1c246-7090-43bc-9dfe-ef10a5085fac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:25.264624 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-32e1c246-7090-43bc-9dfe-ef10a5085fac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:25.266157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-32e1c246-7090-43bc-9dfe-ef10a5085fac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:25.267478 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-32e1c246-7090-43bc-9dfe-ef10a5085fac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1406 microversion: 2.20 time: 1.324429 Oct 28 19:06:25.268639 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 26/45] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:23 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1406 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:06:25.286558 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a05cf17a-7c56-4a98-b0e7-81b593255de6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:25.287550 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-a05cf17a-7c56-4a98-b0e7-81b593255de6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:25.297218 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a05cf17a-7c56-4a98-b0e7-81b593255de6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:25.298066 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a05cf17a-7c56-4a98-b0e7-81b593255de6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:25.298809 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a05cf17a-7c56-4a98-b0e7-81b593255de6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:25.300329 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a05cf17a-7c56-4a98-b0e7-81b593255de6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:25.303583 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a05cf17a-7c56-4a98-b0e7-81b593255de6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:25.304281 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a05cf17a-7c56-4a98-b0e7-81b593255de6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:25.669945 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-a05cf17a-7c56-4a98-b0e7-81b593255de6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:25.697288 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-a05cf17a-7c56-4a98-b0e7-81b593255de6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1280 microversion: 2.1 time: 0.427254 Oct 28 19:06:25.702819 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-9f96c1e2-7a4d-477a-a62c-778f439da7c7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:25.707128 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 27/46] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:25 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1280 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:25.716749 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-9f96c1e2-7a4d-477a-a62c-778f439da7c7 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 1.717612 Oct 28 19:06:25.717390 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 20/47] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:23 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:26.301617 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a8824b08-6dc0-40cd-a28e-f9e3676351ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:26.303895 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-a8824b08-6dc0-40cd-a28e-f9e3676351ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:26.326101 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a8824b08-6dc0-40cd-a28e-f9e3676351ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:26.328709 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a8824b08-6dc0-40cd-a28e-f9e3676351ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:26.333319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a8824b08-6dc0-40cd-a28e-f9e3676351ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:26.336212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a8824b08-6dc0-40cd-a28e-f9e3676351ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:26.340124 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a8824b08-6dc0-40cd-a28e-f9e3676351ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:26.342332 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a8824b08-6dc0-40cd-a28e-f9e3676351ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:26.732460 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-eddf86fc-e15d-4a74-b06c-d2931836f156 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:26.733748 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-eddf86fc-e15d-4a74-b06c-d2931836f156 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:26.744862 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=10 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:26.746690 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eddf86fc-e15d-4a74-b06c-d2931836f156 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:26.757825 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eddf86fc-e15d-4a74-b06c-d2931836f156 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:26.758489 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eddf86fc-e15d-4a74-b06c-d2931836f156 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:26.759526 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eddf86fc-e15d-4a74-b06c-d2931836f156 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:26.760444 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eddf86fc-e15d-4a74-b06c-d2931836f156 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:26.761063 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eddf86fc-e15d-4a74-b06c-d2931836f156 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:26.961059 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-eddf86fc-e15d-4a74-b06c-d2931836f156 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:26.970367 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-eddf86fc-e15d-4a74-b06c-d2931836f156 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1280 microversion: 2.1 time: 0.241646 Oct 28 19:06:26.971451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 21/48] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:26 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:26.976882 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-fb7a1d69-ef15-4a53-b70f-e62c85b94461 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:26.977680 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-fb7a1d69-ef15-4a53-b70f-e62c85b94461 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:26.984263 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fb7a1d69-ef15-4a53-b70f-e62c85b94461 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:26.984657 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-a8824b08-6dc0-40cd-a28e-f9e3676351ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:26.985495 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fb7a1d69-ef15-4a53-b70f-e62c85b94461 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:26.986180 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fb7a1d69-ef15-4a53-b70f-e62c85b94461 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:26.987748 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fb7a1d69-ef15-4a53-b70f-e62c85b94461 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:26.988494 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fb7a1d69-ef15-4a53-b70f-e62c85b94461 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:26.989137 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fb7a1d69-ef15-4a53-b70f-e62c85b94461 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:26.993401 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-a8824b08-6dc0-40cd-a28e-f9e3676351ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:26.994850 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-a8824b08-6dc0-40cd-a28e-f9e3676351ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:27.012725 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-a8824b08-6dc0-40cd-a28e-f9e3676351ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1406 microversion: 2.20 time: 0.719490 Oct 28 19:06:27.013843 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 28/49] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:26 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1406 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:06:27.596391 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-fb7a1d69-ef15-4a53-b70f-e62c85b94461 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:27.610584 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-fb7a1d69-ef15-4a53-b70f-e62c85b94461 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.637624 Oct 28 19:06:27.637779 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 22/50] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:26 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:27.995933 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-6ede106a-2124-402a-ad0c-79a0393d8f14 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:28.010963 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-6ede106a-2124-402a-ad0c-79a0393d8f14 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:28.034956 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6ede106a-2124-402a-ad0c-79a0393d8f14 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:28.038424 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6ede106a-2124-402a-ad0c-79a0393d8f14 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:28.040252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6ede106a-2124-402a-ad0c-79a0393d8f14 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:28.042959 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6ede106a-2124-402a-ad0c-79a0393d8f14 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:28.045568 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6ede106a-2124-402a-ad0c-79a0393d8f14 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:28.047433 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6ede106a-2124-402a-ad0c-79a0393d8f14 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:28.342263 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-2f92821a-60e1-4045-85e1-dda6cfb9adc3 req-14712d62-a817-4710-8921-0ac1ff5eb22e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "777c1a8e-485a-4333-a800-8586cdc8746b", "tag": "63e7b2ed-34d6-4aba-a769-655ad469dbc0"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:28.371034 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-2f92821a-60e1-4045-85e1-dda6cfb9adc3 req-14712d62-a817-4710-8921-0ac1ff5eb22e service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:28.371860 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-2f92821a-60e1-4045-85e1-dda6cfb9adc3 req-14712d62-a817-4710-8921-0ac1ff5eb22e service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:28.372451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-2f92821a-60e1-4045-85e1-dda6cfb9adc3 req-14712d62-a817-4710-8921-0ac1ff5eb22e service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:28.432991 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-2f92821a-60e1-4045-85e1-dda6cfb9adc3 req-14712d62-a817-4710-8921-0ac1ff5eb22e service nova] Creating event network-changed:63e7b2ed-34d6-4aba-a769-655ad469dbc0 for instance 777c1a8e-485a-4333-a800-8586cdc8746b on hv-cinder-86236 Oct 28 19:06:28.436002 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-2f92821a-60e1-4045-85e1-dda6cfb9adc3 req-14712d62-a817-4710-8921-0ac1ff5eb22e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 19:06:28.439223 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-6ede106a-2124-402a-ad0c-79a0393d8f14 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:28.441916 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-2f92821a-60e1-4045-85e1-dda6cfb9adc3 req-14712d62-a817-4710-8921-0ac1ff5eb22e service nova] Acquired lock "compute-rpcapi-router" {{(pid=118875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 19:06:28.443526 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5d6bb570-31cc-49e0-8713-e1686a2e0ba5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:28.444184 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5d6bb570-31cc-49e0-8713-e1686a2e0ba5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:28.445743 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5d6bb570-31cc-49e0-8713-e1686a2e0ba5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:28.447398 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5d6bb570-31cc-49e0-8713-e1686a2e0ba5 None None] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:28.454151 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5d6bb570-31cc-49e0-8713-e1686a2e0ba5 None None] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:28.454966 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5d6bb570-31cc-49e0-8713-e1686a2e0ba5 None None] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:28.456806 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-6ede106a-2124-402a-ad0c-79a0393d8f14 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1280 microversion: 2.1 time: 0.464963 Oct 28 19:06:28.459282 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 29/51] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:27 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1280 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:28.474567 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.compute.rpcapi [None req-5d6bb570-31cc-49e0-8713-e1686a2e0ba5 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 28 19:06:28.475950 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5d6bb570-31cc-49e0-8713-e1686a2e0ba5 None None] Releasing lock "compute-rpcapi-router" {{(pid=118875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 19:06:28.482510 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-d4b17e21-657b-44f3-b482-29ac17142c50 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:28.483196 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-d4b17e21-657b-44f3-b482-29ac17142c50 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:28.496638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d4b17e21-657b-44f3-b482-29ac17142c50 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:28.497148 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d4b17e21-657b-44f3-b482-29ac17142c50 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:28.503661 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d4b17e21-657b-44f3-b482-29ac17142c50 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:28.504814 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d4b17e21-657b-44f3-b482-29ac17142c50 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:28.505708 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d4b17e21-657b-44f3-b482-29ac17142c50 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:28.506782 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-5d6bb570-31cc-49e0-8713-e1686a2e0ba5 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.492005 Oct 28 19:06:28.507962 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d4b17e21-657b-44f3-b482-29ac17142c50 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:28.508389 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 23/52] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:28.640924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-8412402b-3d1e-4294-91e6-07fc0ae30a80 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:28.644307 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-8412402b-3d1e-4294-91e6-07fc0ae30a80 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:28.671292 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8412402b-3d1e-4294-91e6-07fc0ae30a80 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:28.672527 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8412402b-3d1e-4294-91e6-07fc0ae30a80 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:28.673090 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8412402b-3d1e-4294-91e6-07fc0ae30a80 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:28.683112 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8412402b-3d1e-4294-91e6-07fc0ae30a80 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:28.683834 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8412402b-3d1e-4294-91e6-07fc0ae30a80 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:28.684932 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8412402b-3d1e-4294-91e6-07fc0ae30a80 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:28.909521 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-d4b17e21-657b-44f3-b482-29ac17142c50 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:28.924953 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-d4b17e21-657b-44f3-b482-29ac17142c50 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:28.929315 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-d4b17e21-657b-44f3-b482-29ac17142c50 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:28.935358 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-d4b17e21-657b-44f3-b482-29ac17142c50 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1406 microversion: 2.20 time: 0.470122 Oct 28 19:06:28.940649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 30/53] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:28 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1406 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:06:29.013105 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-8412402b-3d1e-4294-91e6-07fc0ae30a80 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:29.032668 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-8412402b-3d1e-4294-91e6-07fc0ae30a80 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.397171 Oct 28 19:06:29.034896 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 24/54] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:28 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:06:29.484694 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-5348dc53-76f9-4975-bfe4-25522d5e3774 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:29.485346 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-5348dc53-76f9-4975-bfe4-25522d5e3774 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:29.499372 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5348dc53-76f9-4975-bfe4-25522d5e3774 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:29.500059 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5348dc53-76f9-4975-bfe4-25522d5e3774 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:29.500781 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5348dc53-76f9-4975-bfe4-25522d5e3774 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:29.503401 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5348dc53-76f9-4975-bfe4-25522d5e3774 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:29.503983 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5348dc53-76f9-4975-bfe4-25522d5e3774 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:29.504299 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5348dc53-76f9-4975-bfe4-25522d5e3774 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:29.535736 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-4218c7b5-c2f8-47c3-bb84-21e86c5031f9 req-4c508a7b-f8ba-4393-8e89-ee969e3175a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "713b7fcb-dff0-4d52-b071-05b218732625", "tag": "86a8ea3e-f71c-4a62-92c2-eeca88631594"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:29.559129 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-4218c7b5-c2f8-47c3-bb84-21e86c5031f9 req-4c508a7b-f8ba-4393-8e89-ee969e3175a1 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:29.567361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-4218c7b5-c2f8-47c3-bb84-21e86c5031f9 req-4c508a7b-f8ba-4393-8e89-ee969e3175a1 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:29.570062 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-4218c7b5-c2f8-47c3-bb84-21e86c5031f9 req-4c508a7b-f8ba-4393-8e89-ee969e3175a1 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:29.612500 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-4218c7b5-c2f8-47c3-bb84-21e86c5031f9 req-4c508a7b-f8ba-4393-8e89-ee969e3175a1 service nova] Creating event network-changed:86a8ea3e-f71c-4a62-92c2-eeca88631594 for instance 713b7fcb-dff0-4d52-b071-05b218732625 on hv-cinder-86236 Oct 28 19:06:29.613195 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-4218c7b5-c2f8-47c3-bb84-21e86c5031f9 req-4c508a7b-f8ba-4393-8e89-ee969e3175a1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118874) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 19:06:29.613649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-4218c7b5-c2f8-47c3-bb84-21e86c5031f9 req-4c508a7b-f8ba-4393-8e89-ee969e3175a1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118874) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 19:06:29.614841 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-310c48c9-2578-48f6-af78-185266313c3d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:29.615780 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-310c48c9-2578-48f6-af78-185266313c3d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:29.616393 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-310c48c9-2578-48f6-af78-185266313c3d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:29.617340 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-310c48c9-2578-48f6-af78-185266313c3d None None] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:29.617858 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-310c48c9-2578-48f6-af78-185266313c3d None None] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:29.618345 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-310c48c9-2578-48f6-af78-185266313c3d None None] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:29.633307 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.compute.rpcapi [None req-310c48c9-2578-48f6-af78-185266313c3d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 28 19:06:29.634454 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-310c48c9-2578-48f6-af78-185266313c3d None None] Releasing lock "compute-rpcapi-router" {{(pid=118874) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 19:06:29.671158 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-310c48c9-2578-48f6-af78-185266313c3d None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233385 Oct 28 19:06:29.674589 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 31/55] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:29.709039 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-7ccf9721-0b2e-4b10-80bf-6bec990b2499 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1906553785", "imageRef": "cd92a575-ed0d-417b-b416-3471be3ba100", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "576c14f7-6c20-4b62-b312-ff07e7f923c3"}], "security_groups": [{"name": "tempest-securitygroup--916168621"}], "key_name": "tempest-keypair-1647481399", "user_data": "}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:29.710006 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-5348dc53-76f9-4975-bfe4-25522d5e3774 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:29.724425 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-5348dc53-76f9-4975-bfe4-25522d5e3774 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1280 microversion: 2.1 time: 0.244388 Oct 28 19:06:29.725035 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 25/56] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:29 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1280 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:06:29.889618 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.network.neutron [None req-7ccf9721-0b2e-4b10-80bf-6bec990b2499 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] validate_networks() for [('576c14f7-6c20-4b62-b312-ff07e7f923c3', None, None, None, None, None)] {{(pid=118874) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:06:29.968223 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-3d07bf72-54a1-41f6-b26a-2e2c723a5886 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:29.969104 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-3d07bf72-54a1-41f6-b26a-2e2c723a5886 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:29.978441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3d07bf72-54a1-41f6-b26a-2e2c723a5886 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:29.980623 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3d07bf72-54a1-41f6-b26a-2e2c723a5886 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:29.984042 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3d07bf72-54a1-41f6-b26a-2e2c723a5886 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:29.989856 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3d07bf72-54a1-41f6-b26a-2e2c723a5886 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:29.990525 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3d07bf72-54a1-41f6-b26a-2e2c723a5886 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:29.991919 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3d07bf72-54a1-41f6-b26a-2e2c723a5886 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:30.568180 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3d07bf72-54a1-41f6-b26a-2e2c723a5886 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:30.599650 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3d07bf72-54a1-41f6-b26a-2e2c723a5886 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:30.601157 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3d07bf72-54a1-41f6-b26a-2e2c723a5886 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:30.602351 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-3d07bf72-54a1-41f6-b26a-2e2c723a5886 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1406 microversion: 2.20 time: 0.638528 Oct 28 19:06:30.602927 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 26/57] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:29 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1406 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:06:30.619850 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-590ac307-dd83-4eff-bc59-ed15121062c5 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:30.619850 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-590ac307-dd83-4eff-bc59-ed15121062c5 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:30.622295 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-590ac307-dd83-4eff-bc59-ed15121062c5 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:30.622811 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-590ac307-dd83-4eff-bc59-ed15121062c5 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:30.627940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-590ac307-dd83-4eff-bc59-ed15121062c5 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:30.628701 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-590ac307-dd83-4eff-bc59-ed15121062c5 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:30.629182 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-590ac307-dd83-4eff-bc59-ed15121062c5 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:30.635598 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-590ac307-dd83-4eff-bc59-ed15121062c5 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:30.950267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-590ac307-dd83-4eff-bc59-ed15121062c5 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:30.962273 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-590ac307-dd83-4eff-bc59-ed15121062c5 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.357918 Oct 28 19:06:30.979278 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 27/58] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:30 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:30.984780 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-5ecbe601-4897-4d3c-ae10-b4a8666731ca req-daef44de-8396-446d-bd18-1d003b16b5eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cc0087a-43d0-43ff-b2b7-3b0b50269c3f", "tag": "7bc5fd69-bbc5-4047-80dc-00c3455bdb88"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:30.996381 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-5ecbe601-4897-4d3c-ae10-b4a8666731ca req-daef44de-8396-446d-bd18-1d003b16b5eb service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:30.997132 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-5ecbe601-4897-4d3c-ae10-b4a8666731ca req-daef44de-8396-446d-bd18-1d003b16b5eb service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:30.997749 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-5ecbe601-4897-4d3c-ae10-b4a8666731ca req-daef44de-8396-446d-bd18-1d003b16b5eb service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:31.012887 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-5ecbe601-4897-4d3c-ae10-b4a8666731ca req-daef44de-8396-446d-bd18-1d003b16b5eb service nova] Creating event network-changed:7bc5fd69-bbc5-4047-80dc-00c3455bdb88 for instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f on hv-cinder-86236 Oct 28 19:06:31.019790 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-5ecbe601-4897-4d3c-ae10-b4a8666731ca req-daef44de-8396-446d-bd18-1d003b16b5eb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039166 Oct 28 19:06:31.021328 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 28/59] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:31.030055 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-467c0b70-cdf8-4bdc-831d-89c9bd9b9162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:31.030761 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-467c0b70-cdf8-4bdc-831d-89c9bd9b9162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:31.037697 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-467c0b70-cdf8-4bdc-831d-89c9bd9b9162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:31.038239 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-467c0b70-cdf8-4bdc-831d-89c9bd9b9162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:31.039112 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-467c0b70-cdf8-4bdc-831d-89c9bd9b9162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:31.041524 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-467c0b70-cdf8-4bdc-831d-89c9bd9b9162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:31.042192 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-467c0b70-cdf8-4bdc-831d-89c9bd9b9162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:31.042636 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-467c0b70-cdf8-4bdc-831d-89c9bd9b9162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:31.069370 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-7ccf9721-0b2e-4b10-80bf-6bec990b2499 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Flavor limits 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:06:31.070681 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-7ccf9721-0b2e-4b10-80bf-6bec990b2499 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Image limits 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:06:31.071636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-7ccf9721-0b2e-4b10-80bf-6bec990b2499 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Flavor pref 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:06:31.072229 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-7ccf9721-0b2e-4b10-80bf-6bec990b2499 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Image pref 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:06:31.073071 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-7ccf9721-0b2e-4b10-80bf-6bec990b2499 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:06:31.083829 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7ccf9721-0b2e-4b10-80bf-6bec990b2499 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:31.085173 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7ccf9721-0b2e-4b10-80bf-6bec990b2499 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:31.085773 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7ccf9721-0b2e-4b10-80bf-6bec990b2499 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:31.086707 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7ccf9721-0b2e-4b10-80bf-6bec990b2499 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:31.087826 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7ccf9721-0b2e-4b10-80bf-6bec990b2499 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:31.088431 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7ccf9721-0b2e-4b10-80bf-6bec990b2499 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:31.111246 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-7ccf9721-0b2e-4b10-80bf-6bec990b2499 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Getting quotas for project 526aaf60dd6c42808951c5f48f8fabd2. Resources: {'ram', 'instances', 'cores'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:06:31.117236 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-7ccf9721-0b2e-4b10-80bf-6bec990b2499 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Getting quotas for user a25c8936b368477880f429e818a321fa and project 526aaf60dd6c42808951c5f48f8fabd2. Resources: {'ram', 'instances', 'cores'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:06:31.129544 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-7ccf9721-0b2e-4b10-80bf-6bec990b2499 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Going to run 1 instances... {{(pid=118874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:06:31.132176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-7ccf9721-0b2e-4b10-80bf-6bec990b2499 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd92a575-ed0d-417b-b416-3471be3ba100',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:06:31.195134 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-7ccf9721-0b2e-4b10-80bf-6bec990b2499 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.496282 Oct 28 19:06:31.195975 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 32/60] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Oct 28 19:06:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:06:31.207793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-94133a3e-483e-4b3a-91a6-2ecb739b4a7c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:31.208406 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-94133a3e-483e-4b3a-91a6-2ecb739b4a7c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:31.213746 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-467c0b70-cdf8-4bdc-831d-89c9bd9b9162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:31.223419 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-467c0b70-cdf8-4bdc-831d-89c9bd9b9162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.199977 Oct 28 19:06:31.224223 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 29/61] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:31 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:31.272517 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-94133a3e-483e-4b3a-91a6-2ecb739b4a7c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:31.280721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-94133a3e-483e-4b3a-91a6-2ecb739b4a7c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1238 microversion: 2.1 time: 0.077482 Oct 28 19:06:31.295154 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 33/62] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:31 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:06:31.636215 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-bcbdfd09-7fb6-4a9a-905f-b9fb4ffd9b16 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:31.637800 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-bcbdfd09-7fb6-4a9a-905f-b9fb4ffd9b16 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:31.640067 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell0:SELECT=28 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:31.646701 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bcbdfd09-7fb6-4a9a-905f-b9fb4ffd9b16 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:31.647308 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bcbdfd09-7fb6-4a9a-905f-b9fb4ffd9b16 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:31.647822 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bcbdfd09-7fb6-4a9a-905f-b9fb4ffd9b16 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:31.648603 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bcbdfd09-7fb6-4a9a-905f-b9fb4ffd9b16 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:31.649140 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bcbdfd09-7fb6-4a9a-905f-b9fb4ffd9b16 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:31.649637 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bcbdfd09-7fb6-4a9a-905f-b9fb4ffd9b16 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:31.986188 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-30c7b059-ff7a-48ee-96b5-ec33080e2bab tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:31.987736 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-30c7b059-ff7a-48ee-96b5-ec33080e2bab tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:32.004054 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-30c7b059-ff7a-48ee-96b5-ec33080e2bab tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.004559 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-30c7b059-ff7a-48ee-96b5-ec33080e2bab tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.005008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-30c7b059-ff7a-48ee-96b5-ec33080e2bab tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.005728 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-30c7b059-ff7a-48ee-96b5-ec33080e2bab tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.006189 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-30c7b059-ff7a-48ee-96b5-ec33080e2bab tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.006634 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-30c7b059-ff7a-48ee-96b5-ec33080e2bab tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.062017 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-bcbdfd09-7fb6-4a9a-905f-b9fb4ffd9b16 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:32.077640 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-bcbdfd09-7fb6-4a9a-905f-b9fb4ffd9b16 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:32.082823 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-bcbdfd09-7fb6-4a9a-905f-b9fb4ffd9b16 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:32.087809 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-bcbdfd09-7fb6-4a9a-905f-b9fb4ffd9b16 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1406 microversion: 2.20 time: 0.452451 Oct 28 19:06:32.089130 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 30/63] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:31 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:06:32.246468 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-42876bdb-59ee-4823-a0e7-f6426b4f01fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:32.247705 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-42876bdb-59ee-4823-a0e7-f6426b4f01fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:32.250450 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-30c7b059-ff7a-48ee-96b5-ec33080e2bab tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:32.257863 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-42876bdb-59ee-4823-a0e7-f6426b4f01fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.258596 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-42876bdb-59ee-4823-a0e7-f6426b4f01fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.259636 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-42876bdb-59ee-4823-a0e7-f6426b4f01fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.260565 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-42876bdb-59ee-4823-a0e7-f6426b4f01fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.261143 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-30c7b059-ff7a-48ee-96b5-ec33080e2bab tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.279068 Oct 28 19:06:32.261425 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-42876bdb-59ee-4823-a0e7-f6426b4f01fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.275310 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 34/64] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:31 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:06:32.278228 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-42876bdb-59ee-4823-a0e7-f6426b4f01fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.305826 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4ca49965-8fca-4f90-a1e6-249c4842a4d0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:32.306050 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-4ca49965-8fca-4f90-a1e6-249c4842a4d0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:32.335569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4ca49965-8fca-4f90-a1e6-249c4842a4d0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.336314 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4ca49965-8fca-4f90-a1e6-249c4842a4d0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.336775 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4ca49965-8fca-4f90-a1e6-249c4842a4d0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.340975 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4ca49965-8fca-4f90-a1e6-249c4842a4d0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.345656 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4ca49965-8fca-4f90-a1e6-249c4842a4d0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.346730 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4ca49965-8fca-4f90-a1e6-249c4842a4d0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.363432 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=100 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:32.498045 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4ca49965-8fca-4f90-a1e6-249c4842a4d0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:32.507411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-4ca49965-8fca-4f90-a1e6-249c4842a4d0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1290 microversion: 2.1 time: 0.206093 Oct 28 19:06:32.507899 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 35/65] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:32 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1290 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:06:32.560227 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-42876bdb-59ee-4823-a0e7-f6426b4f01fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:32.575316 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-42876bdb-59ee-4823-a0e7-f6426b4f01fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.333214 Oct 28 19:06:32.576597 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 31/66] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:32 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:06:33.117162 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-5195ccf8-8e0d-4dd8-b7be-11dc9193d48d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:33.117909 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-5195ccf8-8e0d-4dd8-b7be-11dc9193d48d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:33.131350 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5195ccf8-8e0d-4dd8-b7be-11dc9193d48d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:33.131847 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5195ccf8-8e0d-4dd8-b7be-11dc9193d48d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:33.132296 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5195ccf8-8e0d-4dd8-b7be-11dc9193d48d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:33.143245 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5195ccf8-8e0d-4dd8-b7be-11dc9193d48d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:33.143762 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5195ccf8-8e0d-4dd8-b7be-11dc9193d48d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:33.144190 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5195ccf8-8e0d-4dd8-b7be-11dc9193d48d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:33.292070 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-72427116-e8a3-44d0-be7c-278285a4bb37 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:33.293296 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-72427116-e8a3-44d0-be7c-278285a4bb37 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:33.306336 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-72427116-e8a3-44d0-be7c-278285a4bb37 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:33.307339 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-72427116-e8a3-44d0-be7c-278285a4bb37 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:33.308070 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-72427116-e8a3-44d0-be7c-278285a4bb37 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:33.311255 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-72427116-e8a3-44d0-be7c-278285a4bb37 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:33.311733 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-72427116-e8a3-44d0-be7c-278285a4bb37 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:33.312169 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-72427116-e8a3-44d0-be7c-278285a4bb37 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:33.353350 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=100 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:33.677120 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-5195ccf8-8e0d-4dd8-b7be-11dc9193d48d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:33.685938 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-5195ccf8-8e0d-4dd8-b7be-11dc9193d48d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:33.687424 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-5195ccf8-8e0d-4dd8-b7be-11dc9193d48d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:33.688527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-5195ccf8-8e0d-4dd8-b7be-11dc9193d48d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1406 microversion: 2.20 time: 0.576681 Oct 28 19:06:33.689094 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 36/67] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:33 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1406 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:06:33.727068 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-988f69e1-dace-410a-b397-037ac0f5a86d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:33.737313 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-988f69e1-dace-410a-b397-037ac0f5a86d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:33.749336 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-988f69e1-dace-410a-b397-037ac0f5a86d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:33.749883 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-988f69e1-dace-410a-b397-037ac0f5a86d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:33.753172 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-988f69e1-dace-410a-b397-037ac0f5a86d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:33.755780 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-988f69e1-dace-410a-b397-037ac0f5a86d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:33.756276 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-988f69e1-dace-410a-b397-037ac0f5a86d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:33.756711 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-988f69e1-dace-410a-b397-037ac0f5a86d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:33.790695 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-72427116-e8a3-44d0-be7c-278285a4bb37 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:33.804871 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-72427116-e8a3-44d0-be7c-278285a4bb37 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.517505 Oct 28 19:06:33.805456 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 32/68] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:33 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:33.824180 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-97db8174-6bd3-4c20-bf27-813ea37d8f9b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:33.825116 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-97db8174-6bd3-4c20-bf27-813ea37d8f9b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:33.858826 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-97db8174-6bd3-4c20-bf27-813ea37d8f9b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:33.861654 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-97db8174-6bd3-4c20-bf27-813ea37d8f9b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:33.862285 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-97db8174-6bd3-4c20-bf27-813ea37d8f9b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:33.864207 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-97db8174-6bd3-4c20-bf27-813ea37d8f9b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:33.868047 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-97db8174-6bd3-4c20-bf27-813ea37d8f9b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:33.868925 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-97db8174-6bd3-4c20-bf27-813ea37d8f9b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:33.896566 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-988f69e1-dace-410a-b397-037ac0f5a86d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:33.909471 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-988f69e1-dace-410a-b397-037ac0f5a86d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1290 microversion: 2.1 time: 0.191037 Oct 28 19:06:33.910816 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 37/69] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:33 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1290 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:33.955912 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-be502827-0300-4120-a3da-1348620c9683 req-f7833240-7e9a-466d-bc20-da0bcce679c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48109dc7-b13e-4e6f-ad81-fd2e296fce62", "tag": "ef2ab85a-6668-4509-8eda-8a1c2af741e2"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:33.978270 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-be502827-0300-4120-a3da-1348620c9683 req-f7833240-7e9a-466d-bc20-da0bcce679c7 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:33.978728 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-be502827-0300-4120-a3da-1348620c9683 req-f7833240-7e9a-466d-bc20-da0bcce679c7 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:33.979369 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-be502827-0300-4120-a3da-1348620c9683 req-f7833240-7e9a-466d-bc20-da0bcce679c7 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:34.011683 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-be502827-0300-4120-a3da-1348620c9683 req-f7833240-7e9a-466d-bc20-da0bcce679c7 service nova] Creating event network-changed:ef2ab85a-6668-4509-8eda-8a1c2af741e2 for instance 48109dc7-b13e-4e6f-ad81-fd2e296fce62 on hv-cinder-86236 Oct 28 19:06:34.019692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-be502827-0300-4120-a3da-1348620c9683 req-f7833240-7e9a-466d-bc20-da0bcce679c7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071307 Oct 28 19:06:34.020695 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 38/70] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:34.123263 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-97db8174-6bd3-4c20-bf27-813ea37d8f9b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:34.135785 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-97db8174-6bd3-4c20-bf27-813ea37d8f9b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.329272 Oct 28 19:06:34.137999 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 33/71] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:33 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:34.718263 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-3d98c5b0-cfea-4b9d-a9ef-da359196efb5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:34.719082 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-3d98c5b0-cfea-4b9d-a9ef-da359196efb5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:34.742339 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3d98c5b0-cfea-4b9d-a9ef-da359196efb5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:34.743257 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3d98c5b0-cfea-4b9d-a9ef-da359196efb5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:34.743863 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3d98c5b0-cfea-4b9d-a9ef-da359196efb5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:34.745745 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3d98c5b0-cfea-4b9d-a9ef-da359196efb5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:34.755987 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3d98c5b0-cfea-4b9d-a9ef-da359196efb5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:34.756850 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3d98c5b0-cfea-4b9d-a9ef-da359196efb5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:34.833963 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b71f3f2a-ac5e-4615-966c-d4923ad9b9b3 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:34.835402 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b71f3f2a-ac5e-4615-966c-d4923ad9b9b3 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:34.855102 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b71f3f2a-ac5e-4615-966c-d4923ad9b9b3 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:34.855663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b71f3f2a-ac5e-4615-966c-d4923ad9b9b3 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:34.856120 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b71f3f2a-ac5e-4615-966c-d4923ad9b9b3 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:34.856860 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b71f3f2a-ac5e-4615-966c-d4923ad9b9b3 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:34.859497 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b71f3f2a-ac5e-4615-966c-d4923ad9b9b3 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:34.860449 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b71f3f2a-ac5e-4615-966c-d4923ad9b9b3 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:35.384644 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b71f3f2a-ac5e-4615-966c-d4923ad9b9b3 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:35.393542 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b71f3f2a-ac5e-4615-966c-d4923ad9b9b3 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.563407 Oct 28 19:06:35.393935 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 34/72] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:34 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:35.410865 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-46b321a0-f94e-46da-8a9e-5148d9f29859 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:35.411547 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-46b321a0-f94e-46da-8a9e-5148d9f29859 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:35.426062 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-46b321a0-f94e-46da-8a9e-5148d9f29859 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:35.426558 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-46b321a0-f94e-46da-8a9e-5148d9f29859 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:35.427022 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-46b321a0-f94e-46da-8a9e-5148d9f29859 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:35.427741 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-46b321a0-f94e-46da-8a9e-5148d9f29859 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:35.428198 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-46b321a0-f94e-46da-8a9e-5148d9f29859 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:35.428628 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-46b321a0-f94e-46da-8a9e-5148d9f29859 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:35.603569 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-46b321a0-f94e-46da-8a9e-5148d9f29859 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:35.612989 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-46b321a0-f94e-46da-8a9e-5148d9f29859 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1296 microversion: 2.1 time: 0.218019 Oct 28 19:06:35.613579 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 35/73] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:35 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1296 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:35.630825 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d8a1e9f2-78f7-4ba2-9579-175688efafb7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:35.631716 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d8a1e9f2-78f7-4ba2-9579-175688efafb7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:35.640925 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d8a1e9f2-78f7-4ba2-9579-175688efafb7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:35.641762 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d8a1e9f2-78f7-4ba2-9579-175688efafb7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:35.642428 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d8a1e9f2-78f7-4ba2-9579-175688efafb7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:35.645264 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d8a1e9f2-78f7-4ba2-9579-175688efafb7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:35.646163 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d8a1e9f2-78f7-4ba2-9579-175688efafb7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:35.646840 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d8a1e9f2-78f7-4ba2-9579-175688efafb7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:35.754704 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3d98c5b0-cfea-4b9d-a9ef-da359196efb5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:35.768769 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3d98c5b0-cfea-4b9d-a9ef-da359196efb5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:35.774791 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3d98c5b0-cfea-4b9d-a9ef-da359196efb5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:35.778276 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-3d98c5b0-cfea-4b9d-a9ef-da359196efb5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1406 microversion: 2.20 time: 1.064187 Oct 28 19:06:35.779253 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 39/74] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:34 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1406 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:06:35.995610 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d8a1e9f2-78f7-4ba2-9579-175688efafb7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:36.008399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d8a1e9f2-78f7-4ba2-9579-175688efafb7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.389075 Oct 28 19:06:36.027788 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 36/75] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:35 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:36.421391 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-e5977342-0fd3-4f54-a8cb-18f6648d20da tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:36.422012 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-e5977342-0fd3-4f54-a8cb-18f6648d20da tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:36.438606 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e5977342-0fd3-4f54-a8cb-18f6648d20da tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:36.439139 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e5977342-0fd3-4f54-a8cb-18f6648d20da tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:36.442387 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e5977342-0fd3-4f54-a8cb-18f6648d20da tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:36.445802 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e5977342-0fd3-4f54-a8cb-18f6648d20da tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:36.446325 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e5977342-0fd3-4f54-a8cb-18f6648d20da tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:36.447038 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e5977342-0fd3-4f54-a8cb-18f6648d20da tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:36.826357 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-2022312a-704b-408d-b273-808fd1e70194 req-a0a91755-fcc4-423b-b108-66297f9be9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "777c1a8e-485a-4333-a800-8586cdc8746b", "name": "network-vif-plugged", "status": "completed", "tag": "63e7b2ed-34d6-4aba-a769-655ad469dbc0"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:36.847063 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-2022312a-704b-408d-b273-808fd1e70194 req-a0a91755-fcc4-423b-b108-66297f9be9a1 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:36.848949 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-2022312a-704b-408d-b273-808fd1e70194 req-a0a91755-fcc4-423b-b108-66297f9be9a1 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:36.851073 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-2022312a-704b-408d-b273-808fd1e70194 req-a0a91755-fcc4-423b-b108-66297f9be9a1 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:36.875824 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-2022312a-704b-408d-b273-808fd1e70194 req-a0a91755-fcc4-423b-b108-66297f9be9a1 service nova] Creating event network-vif-plugged:63e7b2ed-34d6-4aba-a769-655ad469dbc0 for instance 777c1a8e-485a-4333-a800-8586cdc8746b on hv-cinder-86236 Oct 28 19:06:36.886614 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-2022312a-704b-408d-b273-808fd1e70194 req-a0a91755-fcc4-423b-b108-66297f9be9a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.497978 Oct 28 19:06:36.888062 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 40/76] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:36.896541 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-cce0d00e-2e6c-47f8-b020-6192a55c5940 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:36.897586 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-cce0d00e-2e6c-47f8-b020-6192a55c5940 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:36.905245 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cce0d00e-2e6c-47f8-b020-6192a55c5940 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:36.905900 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cce0d00e-2e6c-47f8-b020-6192a55c5940 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:36.906495 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cce0d00e-2e6c-47f8-b020-6192a55c5940 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:36.907471 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cce0d00e-2e6c-47f8-b020-6192a55c5940 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:36.908630 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cce0d00e-2e6c-47f8-b020-6192a55c5940 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:36.909234 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cce0d00e-2e6c-47f8-b020-6192a55c5940 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:37.000394 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-e5977342-0fd3-4f54-a8cb-18f6648d20da tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:37.013972 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-e5977342-0fd3-4f54-a8cb-18f6648d20da tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.597574 Oct 28 19:06:37.015633 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 37/77] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:36 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:37.023108 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-a4b2e89d-406e-4d23-83f3-bddb9f99b3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:37.024091 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-a4b2e89d-406e-4d23-83f3-bddb9f99b3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:37.050559 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a4b2e89d-406e-4d23-83f3-bddb9f99b3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:37.052962 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a4b2e89d-406e-4d23-83f3-bddb9f99b3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:37.054460 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a4b2e89d-406e-4d23-83f3-bddb9f99b3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:37.055416 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a4b2e89d-406e-4d23-83f3-bddb9f99b3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:37.058802 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a4b2e89d-406e-4d23-83f3-bddb9f99b3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:37.059443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a4b2e89d-406e-4d23-83f3-bddb9f99b3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:37.409613 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-cce0d00e-2e6c-47f8-b020-6192a55c5940 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:37.421391 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-cce0d00e-2e6c-47f8-b020-6192a55c5940 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.530335 Oct 28 19:06:37.421927 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 41/78] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:36 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:37.437907 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-974aa9ac-f418-4088-a962-029c1f2379fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:37.442407 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-974aa9ac-f418-4088-a962-029c1f2379fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:37.456632 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a4b2e89d-406e-4d23-83f3-bddb9f99b3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:37.467872 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a4b2e89d-406e-4d23-83f3-bddb9f99b3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:37.472452 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-974aa9ac-f418-4088-a962-029c1f2379fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:37.472950 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-974aa9ac-f418-4088-a962-029c1f2379fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:37.475418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-974aa9ac-f418-4088-a962-029c1f2379fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:37.478443 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-974aa9ac-f418-4088-a962-029c1f2379fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:37.481333 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-974aa9ac-f418-4088-a962-029c1f2379fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:37.482790 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a4b2e89d-406e-4d23-83f3-bddb9f99b3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:37.483508 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-974aa9ac-f418-4088-a962-029c1f2379fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:37.484137 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-a4b2e89d-406e-4d23-83f3-bddb9f99b3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1406 microversion: 2.20 time: 0.466629 Oct 28 19:06:37.484734 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 38/79] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:37 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1406 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:06:37.743923 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-974aa9ac-f418-4088-a962-029c1f2379fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:37.756499 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-974aa9ac-f418-4088-a962-029c1f2379fd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.333505 Oct 28 19:06:37.757355 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 42/80] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:37 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:38.043364 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-053982bc-5242-4aca-a992-aacc13a35349 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:38.044790 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-053982bc-5242-4aca-a992-aacc13a35349 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:38.054743 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-053982bc-5242-4aca-a992-aacc13a35349 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:38.055846 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-053982bc-5242-4aca-a992-aacc13a35349 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:38.057117 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-053982bc-5242-4aca-a992-aacc13a35349 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:38.058255 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-053982bc-5242-4aca-a992-aacc13a35349 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:38.059403 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-053982bc-5242-4aca-a992-aacc13a35349 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:38.060735 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-053982bc-5242-4aca-a992-aacc13a35349 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:38.242835 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-053982bc-5242-4aca-a992-aacc13a35349 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:38.254109 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-053982bc-5242-4aca-a992-aacc13a35349 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.214095 Oct 28 19:06:38.255594 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 39/81] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:38 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:38.444681 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a3a87ced-6bea-45ed-8bac-f71d5b0b13a4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:38.445899 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-a3a87ced-6bea-45ed-8bac-f71d5b0b13a4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:38.447873 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:38.453832 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a3a87ced-6bea-45ed-8bac-f71d5b0b13a4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:38.454531 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a3a87ced-6bea-45ed-8bac-f71d5b0b13a4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:38.455192 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a3a87ced-6bea-45ed-8bac-f71d5b0b13a4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:38.456040 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a3a87ced-6bea-45ed-8bac-f71d5b0b13a4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:38.456490 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a3a87ced-6bea-45ed-8bac-f71d5b0b13a4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:38.457032 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a3a87ced-6bea-45ed-8bac-f71d5b0b13a4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:38.512743 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-7c207a73-48c3-434c-ba30-3410e5866542 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:38.513855 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-7c207a73-48c3-434c-ba30-3410e5866542 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:38.516002 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell0:SELECT=8 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:38.523084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7c207a73-48c3-434c-ba30-3410e5866542 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:38.524131 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7c207a73-48c3-434c-ba30-3410e5866542 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:38.524735 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7c207a73-48c3-434c-ba30-3410e5866542 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:38.525692 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7c207a73-48c3-434c-ba30-3410e5866542 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:38.526154 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7c207a73-48c3-434c-ba30-3410e5866542 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:38.526598 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7c207a73-48c3-434c-ba30-3410e5866542 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:38.629930 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-a3a87ced-6bea-45ed-8bac-f71d5b0b13a4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:38.656929 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-a3a87ced-6bea-45ed-8bac-f71d5b0b13a4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.214668 Oct 28 19:06:38.660066 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 43/82] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:38 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:38.781980 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-9ae40ef5-d400-4cf5-bc2d-9872e24364bc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:38.782595 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-9ae40ef5-d400-4cf5-bc2d-9872e24364bc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:38.790016 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9ae40ef5-d400-4cf5-bc2d-9872e24364bc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:38.790503 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9ae40ef5-d400-4cf5-bc2d-9872e24364bc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:38.794431 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9ae40ef5-d400-4cf5-bc2d-9872e24364bc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:38.795725 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9ae40ef5-d400-4cf5-bc2d-9872e24364bc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:38.796427 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9ae40ef5-d400-4cf5-bc2d-9872e24364bc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:38.796931 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9ae40ef5-d400-4cf5-bc2d-9872e24364bc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:38.817908 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-7c207a73-48c3-434c-ba30-3410e5866542 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:38.826813 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-7c207a73-48c3-434c-ba30-3410e5866542 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:38.833027 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-7c207a73-48c3-434c-ba30-3410e5866542 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:38.834456 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-7c207a73-48c3-434c-ba30-3410e5866542 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1406 microversion: 2.20 time: 0.326656 Oct 28 19:06:38.836829 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 40/83] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:38 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:06:39.029044 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-9ae40ef5-d400-4cf5-bc2d-9872e24364bc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:39.041954 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-9ae40ef5-d400-4cf5-bc2d-9872e24364bc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.263631 Oct 28 19:06:39.051995 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 44/84] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:38 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:06:39.278502 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-4ca72066-79fc-41f0-98c0-0d86e9171641 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:39.280021 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-4ca72066-79fc-41f0-98c0-0d86e9171641 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:39.286366 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4ca72066-79fc-41f0-98c0-0d86e9171641 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:39.287090 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4ca72066-79fc-41f0-98c0-0d86e9171641 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:39.287790 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4ca72066-79fc-41f0-98c0-0d86e9171641 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:39.288694 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4ca72066-79fc-41f0-98c0-0d86e9171641 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:39.289388 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4ca72066-79fc-41f0-98c0-0d86e9171641 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:39.290025 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4ca72066-79fc-41f0-98c0-0d86e9171641 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:39.454732 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-4ca72066-79fc-41f0-98c0-0d86e9171641 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:39.466754 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-4ca72066-79fc-41f0-98c0-0d86e9171641 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.192484 Oct 28 19:06:39.479006 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 41/85] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:39 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:39.687954 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-8db39fe8-c2c9-496c-9f44-3a178edbab04 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:39.688564 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-8db39fe8-c2c9-496c-9f44-3a178edbab04 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:39.695300 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8db39fe8-c2c9-496c-9f44-3a178edbab04 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:39.695781 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8db39fe8-c2c9-496c-9f44-3a178edbab04 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:39.696215 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8db39fe8-c2c9-496c-9f44-3a178edbab04 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:39.696910 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8db39fe8-c2c9-496c-9f44-3a178edbab04 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:39.697357 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8db39fe8-c2c9-496c-9f44-3a178edbab04 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:39.697898 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8db39fe8-c2c9-496c-9f44-3a178edbab04 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:39.865039 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-669f9749-cae8-4db8-b195-22b5f80ab3a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:39.865654 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-669f9749-cae8-4db8-b195-22b5f80ab3a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:39.873230 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-669f9749-cae8-4db8-b195-22b5f80ab3a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:39.873718 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-669f9749-cae8-4db8-b195-22b5f80ab3a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:39.876408 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-669f9749-cae8-4db8-b195-22b5f80ab3a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:39.879276 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-8db39fe8-c2c9-496c-9f44-3a178edbab04 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:39.880052 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-669f9749-cae8-4db8-b195-22b5f80ab3a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:39.880858 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-669f9749-cae8-4db8-b195-22b5f80ab3a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:39.881312 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-669f9749-cae8-4db8-b195-22b5f80ab3a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:39.892590 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-8db39fe8-c2c9-496c-9f44-3a178edbab04 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.208356 Oct 28 19:06:39.899898 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 45/86] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:39 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:40.065149 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-6a2e7d4a-b525-40c7-aef5-51f560a932dc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:40.065861 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-669f9749-cae8-4db8-b195-22b5f80ab3a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:40.066152 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-6a2e7d4a-b525-40c7-aef5-51f560a932dc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:40.072125 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6a2e7d4a-b525-40c7-aef5-51f560a932dc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:40.072884 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6a2e7d4a-b525-40c7-aef5-51f560a932dc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:40.073476 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6a2e7d4a-b525-40c7-aef5-51f560a932dc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:40.074358 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6a2e7d4a-b525-40c7-aef5-51f560a932dc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:40.075104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6a2e7d4a-b525-40c7-aef5-51f560a932dc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:40.075817 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6a2e7d4a-b525-40c7-aef5-51f560a932dc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:40.075932 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-669f9749-cae8-4db8-b195-22b5f80ab3a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:40.077365 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-669f9749-cae8-4db8-b195-22b5f80ab3a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:40.078468 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-669f9749-cae8-4db8-b195-22b5f80ab3a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1406 microversion: 2.20 time: 0.218827 Oct 28 19:06:40.091911 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 42/87] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:39 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:06:40.327077 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-6a2e7d4a-b525-40c7-aef5-51f560a932dc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:40.336005 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-6a2e7d4a-b525-40c7-aef5-51f560a932dc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.275249 Oct 28 19:06:40.351583 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 46/88] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:40 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:40.492049 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-95830725-a823-4584-89a1-cfadaf8ab74c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:40.493369 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-95830725-a823-4584-89a1-cfadaf8ab74c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:40.504265 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-95830725-a823-4584-89a1-cfadaf8ab74c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:40.504767 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-95830725-a823-4584-89a1-cfadaf8ab74c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:40.505388 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-95830725-a823-4584-89a1-cfadaf8ab74c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:40.507448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-95830725-a823-4584-89a1-cfadaf8ab74c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:40.511651 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-95830725-a823-4584-89a1-cfadaf8ab74c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:40.512574 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-95830725-a823-4584-89a1-cfadaf8ab74c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:40.694537 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-95830725-a823-4584-89a1-cfadaf8ab74c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:40.705722 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-95830725-a823-4584-89a1-cfadaf8ab74c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.215460 Oct 28 19:06:40.706643 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 43/89] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:40 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:40.918035 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-c544d262-4e4c-49f0-969e-62f1deeb0ef6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:40.919155 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-c544d262-4e4c-49f0-969e-62f1deeb0ef6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:40.926238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c544d262-4e4c-49f0-969e-62f1deeb0ef6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:40.926998 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c544d262-4e4c-49f0-969e-62f1deeb0ef6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:40.927541 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c544d262-4e4c-49f0-969e-62f1deeb0ef6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:40.928246 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c544d262-4e4c-49f0-969e-62f1deeb0ef6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:40.928696 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c544d262-4e4c-49f0-969e-62f1deeb0ef6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:40.929120 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c544d262-4e4c-49f0-969e-62f1deeb0ef6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:41.096681 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=4 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:41.105841 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-ce5a7ce2-2034-4dee-9fdb-45229f0a75b6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:41.106959 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-ce5a7ce2-2034-4dee-9fdb-45229f0a75b6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:41.118803 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ce5a7ce2-2034-4dee-9fdb-45229f0a75b6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:41.120812 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ce5a7ce2-2034-4dee-9fdb-45229f0a75b6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:41.122536 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ce5a7ce2-2034-4dee-9fdb-45229f0a75b6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:41.124495 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ce5a7ce2-2034-4dee-9fdb-45229f0a75b6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:41.125056 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ce5a7ce2-2034-4dee-9fdb-45229f0a75b6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:41.125750 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ce5a7ce2-2034-4dee-9fdb-45229f0a75b6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:41.126197 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-c544d262-4e4c-49f0-969e-62f1deeb0ef6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:41.134815 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-c544d262-4e4c-49f0-969e-62f1deeb0ef6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.221284 Oct 28 19:06:41.137183 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 47/90] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:40 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:41.372095 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-66dd658a-2036-4907-9866-b1c6dc3311cd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:41.372728 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-66dd658a-2036-4907-9866-b1c6dc3311cd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:41.390578 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=20 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:41.395464 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-66dd658a-2036-4907-9866-b1c6dc3311cd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:41.397324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-66dd658a-2036-4907-9866-b1c6dc3311cd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:41.399730 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-66dd658a-2036-4907-9866-b1c6dc3311cd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:41.402329 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-66dd658a-2036-4907-9866-b1c6dc3311cd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:41.402964 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-66dd658a-2036-4907-9866-b1c6dc3311cd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:41.403948 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-66dd658a-2036-4907-9866-b1c6dc3311cd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:41.499694 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ce5a7ce2-2034-4dee-9fdb-45229f0a75b6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:41.513134 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ce5a7ce2-2034-4dee-9fdb-45229f0a75b6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:41.515194 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ce5a7ce2-2034-4dee-9fdb-45229f0a75b6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:41.518994 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-ce5a7ce2-2034-4dee-9fdb-45229f0a75b6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1406 microversion: 2.20 time: 0.417220 Oct 28 19:06:41.531982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 44/91] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:41 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1406 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:06:41.686626 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-f021e6ac-2b42-47e6-8f6f-08fb486550da req-7dc081a1-e201-411f-bf61-f5447cbb2b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "713b7fcb-dff0-4d52-b071-05b218732625", "name": "network-vif-plugged", "status": "completed", "tag": "86a8ea3e-f71c-4a62-92c2-eeca88631594"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:41.703653 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-f021e6ac-2b42-47e6-8f6f-08fb486550da req-7dc081a1-e201-411f-bf61-f5447cbb2b0d service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:41.704462 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-f021e6ac-2b42-47e6-8f6f-08fb486550da req-7dc081a1-e201-411f-bf61-f5447cbb2b0d service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:41.704922 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-f021e6ac-2b42-47e6-8f6f-08fb486550da req-7dc081a1-e201-411f-bf61-f5447cbb2b0d service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:41.721757 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-f021e6ac-2b42-47e6-8f6f-08fb486550da req-7dc081a1-e201-411f-bf61-f5447cbb2b0d service nova] Creating event network-vif-plugged:86a8ea3e-f71c-4a62-92c2-eeca88631594 for instance 713b7fcb-dff0-4d52-b071-05b218732625 on hv-cinder-86236 Oct 28 19:06:41.728381 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-f021e6ac-2b42-47e6-8f6f-08fb486550da req-7dc081a1-e201-411f-bf61-f5447cbb2b0d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065395 Oct 28 19:06:41.729245 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 45/92] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:41.734781 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-ba59a0ee-4c8a-4dde-820b-7ffda1f98785 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:41.735500 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-ba59a0ee-4c8a-4dde-820b-7ffda1f98785 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:41.740981 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-66dd658a-2036-4907-9866-b1c6dc3311cd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:41.745210 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ba59a0ee-4c8a-4dde-820b-7ffda1f98785 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:41.745656 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ba59a0ee-4c8a-4dde-820b-7ffda1f98785 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:41.746116 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ba59a0ee-4c8a-4dde-820b-7ffda1f98785 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:41.746941 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ba59a0ee-4c8a-4dde-820b-7ffda1f98785 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:41.747422 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ba59a0ee-4c8a-4dde-820b-7ffda1f98785 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:41.747848 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ba59a0ee-4c8a-4dde-820b-7ffda1f98785 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:41.759948 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-66dd658a-2036-4907-9866-b1c6dc3311cd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.404920 Oct 28 19:06:41.760527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 48/93] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:41 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:42.007646 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ba59a0ee-4c8a-4dde-820b-7ffda1f98785 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:42.017673 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-ba59a0ee-4c8a-4dde-820b-7ffda1f98785 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.287118 Oct 28 19:06:42.019933 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 46/94] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:41 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:42.162170 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1603dc0d-0a3b-4135-8270-89dad7651031 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:42.163284 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-1603dc0d-0a3b-4135-8270-89dad7651031 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:42.176837 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1603dc0d-0a3b-4135-8270-89dad7651031 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:42.177366 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1603dc0d-0a3b-4135-8270-89dad7651031 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:42.177808 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1603dc0d-0a3b-4135-8270-89dad7651031 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:42.178516 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1603dc0d-0a3b-4135-8270-89dad7651031 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:42.178961 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1603dc0d-0a3b-4135-8270-89dad7651031 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:42.179457 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1603dc0d-0a3b-4135-8270-89dad7651031 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:42.506561 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-1603dc0d-0a3b-4135-8270-89dad7651031 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:42.516908 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-1603dc0d-0a3b-4135-8270-89dad7651031 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.359718 Oct 28 19:06:42.519527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 49/95] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:42 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:42.545863 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-785c26a6-8901-4f40-b7b5-c53873188991 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:42.546679 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-785c26a6-8901-4f40-b7b5-c53873188991 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:42.556349 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-785c26a6-8901-4f40-b7b5-c53873188991 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:42.557756 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-785c26a6-8901-4f40-b7b5-c53873188991 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:42.560346 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-785c26a6-8901-4f40-b7b5-c53873188991 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:42.561254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-785c26a6-8901-4f40-b7b5-c53873188991 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:42.564388 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-785c26a6-8901-4f40-b7b5-c53873188991 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:42.564702 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-785c26a6-8901-4f40-b7b5-c53873188991 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:42.652063 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-0510acb3-d4f7-4ec3-b272-53f16885e6d0 req-de05ca24-611f-4bb8-9f37-1eb569c7e010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f3f032-9a74-4361-a6e5-8d7a2c09aa1f", "tag": "2b562495-8684-4c93-b042-c057cbef9900"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:42.668061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-0510acb3-d4f7-4ec3-b272-53f16885e6d0 req-de05ca24-611f-4bb8-9f37-1eb569c7e010 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:42.669090 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-0510acb3-d4f7-4ec3-b272-53f16885e6d0 req-de05ca24-611f-4bb8-9f37-1eb569c7e010 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:42.669899 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-0510acb3-d4f7-4ec3-b272-53f16885e6d0 req-de05ca24-611f-4bb8-9f37-1eb569c7e010 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:42.685402 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-0510acb3-d4f7-4ec3-b272-53f16885e6d0 req-de05ca24-611f-4bb8-9f37-1eb569c7e010 service nova] Creating event network-changed:2b562495-8684-4c93-b042-c057cbef9900 for instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f on hv-cinder-86236 Oct 28 19:06:42.691464 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-0510acb3-d4f7-4ec3-b272-53f16885e6d0 req-de05ca24-611f-4bb8-9f37-1eb569c7e010 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044003 Oct 28 19:06:42.692464 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 50/96] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:06:42.788662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-785c26a6-8901-4f40-b7b5-c53873188991 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:42.792743 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-b07814ec-cf3a-4b76-b7ec-bb24783c4400 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:42.793975 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-b07814ec-cf3a-4b76-b7ec-bb24783c4400 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:42.798085 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-785c26a6-8901-4f40-b7b5-c53873188991 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:42.800283 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-785c26a6-8901-4f40-b7b5-c53873188991 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:42.801419 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-785c26a6-8901-4f40-b7b5-c53873188991 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1406 microversion: 2.20 time: 0.259630 Oct 28 19:06:42.802010 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 47/97] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:42 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1406 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:06:42.808248 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b07814ec-cf3a-4b76-b7ec-bb24783c4400 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:42.808815 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b07814ec-cf3a-4b76-b7ec-bb24783c4400 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:42.809258 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b07814ec-cf3a-4b76-b7ec-bb24783c4400 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:42.809963 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b07814ec-cf3a-4b76-b7ec-bb24783c4400 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:42.810739 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b07814ec-cf3a-4b76-b7ec-bb24783c4400 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:42.811266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b07814ec-cf3a-4b76-b7ec-bb24783c4400 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:42.999110 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-b07814ec-cf3a-4b76-b7ec-bb24783c4400 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:43.010551 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-b07814ec-cf3a-4b76-b7ec-bb24783c4400 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.223833 Oct 28 19:06:43.011633 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 51/98] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:42 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:43.041830 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-60996943-42ab-48d2-a92a-6472cccff13f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:43.042707 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-60996943-42ab-48d2-a92a-6472cccff13f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:43.049553 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-60996943-42ab-48d2-a92a-6472cccff13f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:43.050043 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-60996943-42ab-48d2-a92a-6472cccff13f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:43.050484 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-60996943-42ab-48d2-a92a-6472cccff13f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:43.051211 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-60996943-42ab-48d2-a92a-6472cccff13f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:43.051931 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-60996943-42ab-48d2-a92a-6472cccff13f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:43.053189 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-60996943-42ab-48d2-a92a-6472cccff13f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:43.206212 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-60996943-42ab-48d2-a92a-6472cccff13f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:43.214116 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-60996943-42ab-48d2-a92a-6472cccff13f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.176063 Oct 28 19:06:43.214682 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 48/99] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:43 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:43.541932 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f1e8ada3-e437-4684-8ede-c4af5ac32937 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:43.542545 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f1e8ada3-e437-4684-8ede-c4af5ac32937 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:43.549704 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f1e8ada3-e437-4684-8ede-c4af5ac32937 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:43.550475 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f1e8ada3-e437-4684-8ede-c4af5ac32937 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:43.551019 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f1e8ada3-e437-4684-8ede-c4af5ac32937 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:43.551899 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f1e8ada3-e437-4684-8ede-c4af5ac32937 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:43.552652 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f1e8ada3-e437-4684-8ede-c4af5ac32937 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:43.552781 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f1e8ada3-e437-4684-8ede-c4af5ac32937 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:43.717255 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f1e8ada3-e437-4684-8ede-c4af5ac32937 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:43.725881 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f1e8ada3-e437-4684-8ede-c4af5ac32937 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.187911 Oct 28 19:06:43.726472 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 52/100] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:43 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:43.758654 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-80f12b8b-925f-48ba-9a06-7e5221c3591a req-d9b87465-4cbb-426e-b5da-c5c4c0025c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cc0087a-43d0-43ff-b2b7-3b0b50269c3f", "name": "network-vif-plugged", "status": "completed", "tag": "7bc5fd69-bbc5-4047-80dc-00c3455bdb88"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:43.768844 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-80f12b8b-925f-48ba-9a06-7e5221c3591a req-d9b87465-4cbb-426e-b5da-c5c4c0025c32 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:43.769330 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-80f12b8b-925f-48ba-9a06-7e5221c3591a req-d9b87465-4cbb-426e-b5da-c5c4c0025c32 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:43.769855 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-80f12b8b-925f-48ba-9a06-7e5221c3591a req-d9b87465-4cbb-426e-b5da-c5c4c0025c32 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:43.780929 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-80f12b8b-925f-48ba-9a06-7e5221c3591a req-d9b87465-4cbb-426e-b5da-c5c4c0025c32 service nova] Creating event network-vif-plugged:7bc5fd69-bbc5-4047-80dc-00c3455bdb88 for instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f on hv-cinder-86236 Oct 28 19:06:43.786564 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-80f12b8b-925f-48ba-9a06-7e5221c3591a req-d9b87465-4cbb-426e-b5da-c5c4c0025c32 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031751 Oct 28 19:06:43.787640 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 49/101] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:43.831216 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-95ea7c4a-8fa4-4c92-b1d2-dc4ddc085c97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:43.831827 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-95ea7c4a-8fa4-4c92-b1d2-dc4ddc085c97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:43.837605 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-95ea7c4a-8fa4-4c92-b1d2-dc4ddc085c97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:43.838089 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-95ea7c4a-8fa4-4c92-b1d2-dc4ddc085c97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:43.838602 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-95ea7c4a-8fa4-4c92-b1d2-dc4ddc085c97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:43.839401 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-95ea7c4a-8fa4-4c92-b1d2-dc4ddc085c97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:43.839861 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-95ea7c4a-8fa4-4c92-b1d2-dc4ddc085c97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:43.840296 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-95ea7c4a-8fa4-4c92-b1d2-dc4ddc085c97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:43.973881 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-95ea7c4a-8fa4-4c92-b1d2-dc4ddc085c97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:43.977495 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=100 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:43.983381 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-95ea7c4a-8fa4-4c92-b1d2-dc4ddc085c97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:43.984910 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-95ea7c4a-8fa4-4c92-b1d2-dc4ddc085c97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:43.986653 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-95ea7c4a-8fa4-4c92-b1d2-dc4ddc085c97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1406 microversion: 2.20 time: 0.159033 Oct 28 19:06:43.987316 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 53/102] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:43 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:06:44.034757 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c9fd7dfd-d700-44dd-a0f3-7bba2a4301ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:44.035446 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-c9fd7dfd-d700-44dd-a0f3-7bba2a4301ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:44.041825 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c9fd7dfd-d700-44dd-a0f3-7bba2a4301ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:44.042311 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c9fd7dfd-d700-44dd-a0f3-7bba2a4301ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:44.042749 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c9fd7dfd-d700-44dd-a0f3-7bba2a4301ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:44.043624 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c9fd7dfd-d700-44dd-a0f3-7bba2a4301ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:44.044084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c9fd7dfd-d700-44dd-a0f3-7bba2a4301ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:44.044511 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c9fd7dfd-d700-44dd-a0f3-7bba2a4301ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:44.062509 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=100 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:44.180106 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c9fd7dfd-d700-44dd-a0f3-7bba2a4301ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:44.188375 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-c9fd7dfd-d700-44dd-a0f3-7bba2a4301ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.158435 Oct 28 19:06:44.189090 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 50/103] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:44 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:44.237313 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1cc34300-0e59-40e0-b804-8273ca0c6b5c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:44.237931 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-1cc34300-0e59-40e0-b804-8273ca0c6b5c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:44.244200 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cc34300-0e59-40e0-b804-8273ca0c6b5c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:44.244692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cc34300-0e59-40e0-b804-8273ca0c6b5c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:44.245133 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cc34300-0e59-40e0-b804-8273ca0c6b5c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:44.245912 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cc34300-0e59-40e0-b804-8273ca0c6b5c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:44.246368 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cc34300-0e59-40e0-b804-8273ca0c6b5c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:44.246966 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cc34300-0e59-40e0-b804-8273ca0c6b5c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:44.377880 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-1cc34300-0e59-40e0-b804-8273ca0c6b5c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:44.385724 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-1cc34300-0e59-40e0-b804-8273ca0c6b5c tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.152535 Oct 28 19:06:44.386315 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 54/104] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:44 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:44.750667 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-544f8a00-5d5c-47c3-a426-70c14090a481 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:44.752756 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-544f8a00-5d5c-47c3-a426-70c14090a481 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:44.767966 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-544f8a00-5d5c-47c3-a426-70c14090a481 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:44.767966 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-544f8a00-5d5c-47c3-a426-70c14090a481 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:44.767966 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-544f8a00-5d5c-47c3-a426-70c14090a481 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:44.767966 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-544f8a00-5d5c-47c3-a426-70c14090a481 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:44.768787 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-544f8a00-5d5c-47c3-a426-70c14090a481 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:44.768787 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-544f8a00-5d5c-47c3-a426-70c14090a481 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:45.010997 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-955082c9-4779-45e9-bbde-b8ed77435bf2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:45.011672 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-955082c9-4779-45e9-bbde-b8ed77435bf2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:45.018806 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-955082c9-4779-45e9-bbde-b8ed77435bf2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:45.019338 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-955082c9-4779-45e9-bbde-b8ed77435bf2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:45.019785 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-955082c9-4779-45e9-bbde-b8ed77435bf2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:45.020553 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-955082c9-4779-45e9-bbde-b8ed77435bf2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:45.021029 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-955082c9-4779-45e9-bbde-b8ed77435bf2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:45.021483 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-955082c9-4779-45e9-bbde-b8ed77435bf2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:45.157091 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-544f8a00-5d5c-47c3-a426-70c14090a481 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:45.164672 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-544f8a00-5d5c-47c3-a426-70c14090a481 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.418990 Oct 28 19:06:45.165247 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 51/105] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:44 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:06:45.193847 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-955082c9-4779-45e9-bbde-b8ed77435bf2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:45.201883 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-955082c9-4779-45e9-bbde-b8ed77435bf2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:45.203367 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-955082c9-4779-45e9-bbde-b8ed77435bf2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:45.204476 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-955082c9-4779-45e9-bbde-b8ed77435bf2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1406 microversion: 2.20 time: 0.197395 Oct 28 19:06:45.205035 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 55/106] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:45 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:06:45.210901 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-05762609-c52c-4cba-ab7f-4ef44b6c2200 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:45.211533 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-05762609-c52c-4cba-ab7f-4ef44b6c2200 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:45.217333 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-05762609-c52c-4cba-ab7f-4ef44b6c2200 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:45.217803 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-05762609-c52c-4cba-ab7f-4ef44b6c2200 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:45.218242 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-05762609-c52c-4cba-ab7f-4ef44b6c2200 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:45.218909 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-05762609-c52c-4cba-ab7f-4ef44b6c2200 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:45.219389 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-05762609-c52c-4cba-ab7f-4ef44b6c2200 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:45.219807 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-05762609-c52c-4cba-ab7f-4ef44b6c2200 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:45.346457 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-05762609-c52c-4cba-ab7f-4ef44b6c2200 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:45.353880 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-05762609-c52c-4cba-ab7f-4ef44b6c2200 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.146772 Oct 28 19:06:45.354476 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 52/107] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:45 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:45.408330 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f11df921-d1d2-4878-8bfe-6cce7ba5747f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:45.408861 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f11df921-d1d2-4878-8bfe-6cce7ba5747f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:45.414668 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f11df921-d1d2-4878-8bfe-6cce7ba5747f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:45.415176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f11df921-d1d2-4878-8bfe-6cce7ba5747f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:45.415606 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f11df921-d1d2-4878-8bfe-6cce7ba5747f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:45.416282 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f11df921-d1d2-4878-8bfe-6cce7ba5747f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:45.416730 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f11df921-d1d2-4878-8bfe-6cce7ba5747f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:45.417146 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f11df921-d1d2-4878-8bfe-6cce7ba5747f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:45.544673 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f11df921-d1d2-4878-8bfe-6cce7ba5747f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:45.552119 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f11df921-d1d2-4878-8bfe-6cce7ba5747f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.147630 Oct 28 19:06:45.552702 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 56/108] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:45 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:46.188146 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-64a5879a-23cc-4286-a21f-e4d28f2c3ece tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:46.188675 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-64a5879a-23cc-4286-a21f-e4d28f2c3ece tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:46.195170 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-64a5879a-23cc-4286-a21f-e4d28f2c3ece tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:46.195655 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-64a5879a-23cc-4286-a21f-e4d28f2c3ece tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:46.196098 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-64a5879a-23cc-4286-a21f-e4d28f2c3ece tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:46.196784 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-64a5879a-23cc-4286-a21f-e4d28f2c3ece tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:46.197239 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-64a5879a-23cc-4286-a21f-e4d28f2c3ece tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:46.197662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-64a5879a-23cc-4286-a21f-e4d28f2c3ece tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:46.229295 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4fd13383-d943-4b4c-95ad-d0cd2f15ca10 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:46.229915 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-4fd13383-d943-4b4c-95ad-d0cd2f15ca10 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:46.235877 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4fd13383-d943-4b4c-95ad-d0cd2f15ca10 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:46.236357 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4fd13383-d943-4b4c-95ad-d0cd2f15ca10 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:46.236788 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4fd13383-d943-4b4c-95ad-d0cd2f15ca10 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:46.237468 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4fd13383-d943-4b4c-95ad-d0cd2f15ca10 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:46.237912 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4fd13383-d943-4b4c-95ad-d0cd2f15ca10 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:46.238329 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4fd13383-d943-4b4c-95ad-d0cd2f15ca10 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:46.372606 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-64a5879a-23cc-4286-a21f-e4d28f2c3ece tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:46.380799 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-64a5879a-23cc-4286-a21f-e4d28f2c3ece tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.196551 Oct 28 19:06:46.381355 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 53/109] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:46 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:46.385778 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-6cc87314-a17c-429b-965e-b88850d53f76 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:46.386375 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-6cc87314-a17c-429b-965e-b88850d53f76 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:46.392409 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6cc87314-a17c-429b-965e-b88850d53f76 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:46.392895 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6cc87314-a17c-429b-965e-b88850d53f76 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:46.393330 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6cc87314-a17c-429b-965e-b88850d53f76 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:46.394032 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6cc87314-a17c-429b-965e-b88850d53f76 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:46.394483 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6cc87314-a17c-429b-965e-b88850d53f76 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:46.394905 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6cc87314-a17c-429b-965e-b88850d53f76 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:46.403307 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4fd13383-d943-4b4c-95ad-d0cd2f15ca10 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:46.411397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4fd13383-d943-4b4c-95ad-d0cd2f15ca10 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:46.412855 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4fd13383-d943-4b4c-95ad-d0cd2f15ca10 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:46.414000 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-4fd13383-d943-4b4c-95ad-d0cd2f15ca10 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1598 microversion: 2.20 time: 0.188525 Oct 28 19:06:46.414560 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 57/110] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:06:46 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1598 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:06:46.439521 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-14baa7b9-4288-4169-9238-340fb96d2e9e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:46.439942 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-14baa7b9-4288-4169-9238-340fb96d2e9e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:46.445732 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-14baa7b9-4288-4169-9238-340fb96d2e9e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:46.446207 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-14baa7b9-4288-4169-9238-340fb96d2e9e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:46.446637 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-14baa7b9-4288-4169-9238-340fb96d2e9e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:46.447354 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-14baa7b9-4288-4169-9238-340fb96d2e9e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:46.447790 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-14baa7b9-4288-4169-9238-340fb96d2e9e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:46.448209 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-14baa7b9-4288-4169-9238-340fb96d2e9e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:46.532653 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-6cc87314-a17c-429b-965e-b88850d53f76 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:46.540565 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-6cc87314-a17c-429b-965e-b88850d53f76 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.158270 Oct 28 19:06:46.541224 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 54/111] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:46 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:46.567093 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-14baa7b9-4288-4169-9238-340fb96d2e9e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.132036 Oct 28 19:06:46.567768 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 58/112] 10.222.0.58 () {60 vars in 1316 bytes} [Fri Oct 28 19:06:46 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:06:46.575271 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-7c2d95b7-f3a6-4859-a180-a67d89fb7c32 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:46.575735 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-7c2d95b7-f3a6-4859-a180-a67d89fb7c32 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:46.581709 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7c2d95b7-f3a6-4859-a180-a67d89fb7c32 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:46.582190 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7c2d95b7-f3a6-4859-a180-a67d89fb7c32 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:46.582624 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7c2d95b7-f3a6-4859-a180-a67d89fb7c32 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:46.583356 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7c2d95b7-f3a6-4859-a180-a67d89fb7c32 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:46.583804 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7c2d95b7-f3a6-4859-a180-a67d89fb7c32 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:46.584231 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7c2d95b7-f3a6-4859-a180-a67d89fb7c32 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:46.901570 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-7c2d95b7-f3a6-4859-a180-a67d89fb7c32 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:46.909231 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-7c2d95b7-f3a6-4859-a180-a67d89fb7c32 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.337821 Oct 28 19:06:46.909798 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 55/113] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:46 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:47.404198 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-2c46d3b9-3ad9-4b2c-b696-843403e30a16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:47.404795 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-2c46d3b9-3ad9-4b2c-b696-843403e30a16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:47.410975 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2c46d3b9-3ad9-4b2c-b696-843403e30a16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:47.411482 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2c46d3b9-3ad9-4b2c-b696-843403e30a16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:47.411918 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2c46d3b9-3ad9-4b2c-b696-843403e30a16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:47.412615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2c46d3b9-3ad9-4b2c-b696-843403e30a16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:47.413063 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2c46d3b9-3ad9-4b2c-b696-843403e30a16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:47.413485 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2c46d3b9-3ad9-4b2c-b696-843403e30a16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:47.564465 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-49d2502a-bdc2-47c3-9e3e-7882ed372b7b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:47.565023 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-49d2502a-bdc2-47c3-9e3e-7882ed372b7b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:47.571086 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-49d2502a-bdc2-47c3-9e3e-7882ed372b7b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:47.571607 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-49d2502a-bdc2-47c3-9e3e-7882ed372b7b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:47.572046 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-49d2502a-bdc2-47c3-9e3e-7882ed372b7b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:47.572747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-49d2502a-bdc2-47c3-9e3e-7882ed372b7b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:47.573200 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-49d2502a-bdc2-47c3-9e3e-7882ed372b7b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:47.573625 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-49d2502a-bdc2-47c3-9e3e-7882ed372b7b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:47.732820 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-2c46d3b9-3ad9-4b2c-b696-843403e30a16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:47.735842 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-2c46d3b9-3ad9-4b2c-b696-843403e30a16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.335545 Oct 28 19:06:47.736636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 59/114] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:47 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:47.865904 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-49d2502a-bdc2-47c3-9e3e-7882ed372b7b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:47.875684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-49d2502a-bdc2-47c3-9e3e-7882ed372b7b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.315604 Oct 28 19:06:47.877546 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 56/115] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:47 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:06:47.932455 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-55ec3c84-f588-4429-9c23-17ebeecaaadf tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:47.933337 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-55ec3c84-f588-4429-9c23-17ebeecaaadf tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:47.949957 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-55ec3c84-f588-4429-9c23-17ebeecaaadf tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:47.950892 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-55ec3c84-f588-4429-9c23-17ebeecaaadf tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:47.951461 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-55ec3c84-f588-4429-9c23-17ebeecaaadf tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:47.952324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-55ec3c84-f588-4429-9c23-17ebeecaaadf tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:47.952716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-55ec3c84-f588-4429-9c23-17ebeecaaadf tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:47.953328 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-55ec3c84-f588-4429-9c23-17ebeecaaadf tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:48.154498 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-b04ff718-1bce-43df-9254-368230874fe5 req-d631e25e-cdb2-4690-ba6e-111475582beb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "777c1a8e-485a-4333-a800-8586cdc8746b", "tag": "63e7b2ed-34d6-4aba-a769-655ad469dbc0"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:48.164418 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-b04ff718-1bce-43df-9254-368230874fe5 req-d631e25e-cdb2-4690-ba6e-111475582beb service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:48.164895 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-b04ff718-1bce-43df-9254-368230874fe5 req-d631e25e-cdb2-4690-ba6e-111475582beb service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:48.165325 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-b04ff718-1bce-43df-9254-368230874fe5 req-d631e25e-cdb2-4690-ba6e-111475582beb service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:48.170302 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-55ec3c84-f588-4429-9c23-17ebeecaaadf tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:48.177262 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-b04ff718-1bce-43df-9254-368230874fe5 req-d631e25e-cdb2-4690-ba6e-111475582beb service nova] Creating event network-changed:63e7b2ed-34d6-4aba-a769-655ad469dbc0 for instance 777c1a8e-485a-4333-a800-8586cdc8746b on hv-cinder-86236 Oct 28 19:06:48.179598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-55ec3c84-f588-4429-9c23-17ebeecaaadf tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.251240 Oct 28 19:06:48.180368 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 60/116] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:47 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:48.182509 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-b04ff718-1bce-43df-9254-368230874fe5 req-d631e25e-cdb2-4690-ba6e-111475582beb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031887 Oct 28 19:06:48.183441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 57/117] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:06:48.757992 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f7247d6b-956b-4c51-a591-ae707ce6f926 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:48.758671 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f7247d6b-956b-4c51-a591-ae707ce6f926 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:48.765015 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7247d6b-956b-4c51-a591-ae707ce6f926 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:48.765572 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7247d6b-956b-4c51-a591-ae707ce6f926 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:48.766077 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7247d6b-956b-4c51-a591-ae707ce6f926 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:48.767395 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7247d6b-956b-4c51-a591-ae707ce6f926 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:48.767836 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7247d6b-956b-4c51-a591-ae707ce6f926 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:48.768261 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7247d6b-956b-4c51-a591-ae707ce6f926 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:48.902182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f7247d6b-956b-4c51-a591-ae707ce6f926 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:48.910325 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-1243ffcc-ece3-4cdf-8bb1-965a11abd729 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:48.911760 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-1243ffcc-ece3-4cdf-8bb1-965a11abd729 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:48.919604 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f7247d6b-956b-4c51-a591-ae707ce6f926 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.165747 Oct 28 19:06:48.920483 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 61/118] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:48 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:48.925808 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1243ffcc-ece3-4cdf-8bb1-965a11abd729 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:48.926304 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1243ffcc-ece3-4cdf-8bb1-965a11abd729 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:48.926741 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1243ffcc-ece3-4cdf-8bb1-965a11abd729 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:48.927494 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1243ffcc-ece3-4cdf-8bb1-965a11abd729 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:48.927945 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1243ffcc-ece3-4cdf-8bb1-965a11abd729 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:48.928372 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1243ffcc-ece3-4cdf-8bb1-965a11abd729 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:49.083327 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1243ffcc-ece3-4cdf-8bb1-965a11abd729 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:49.092456 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-1243ffcc-ece3-4cdf-8bb1-965a11abd729 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.193365 Oct 28 19:06:49.107413 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 58/119] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:48 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:49.205609 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-3c0a9654-6f52-47de-ac54-aeb0e392fb08 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:49.206362 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-3c0a9654-6f52-47de-ac54-aeb0e392fb08 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:49.216046 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3c0a9654-6f52-47de-ac54-aeb0e392fb08 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:49.216759 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3c0a9654-6f52-47de-ac54-aeb0e392fb08 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:49.217202 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3c0a9654-6f52-47de-ac54-aeb0e392fb08 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:49.218299 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3c0a9654-6f52-47de-ac54-aeb0e392fb08 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:49.218938 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3c0a9654-6f52-47de-ac54-aeb0e392fb08 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:49.219369 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3c0a9654-6f52-47de-ac54-aeb0e392fb08 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:49.410270 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3c0a9654-6f52-47de-ac54-aeb0e392fb08 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:49.418888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-3c0a9654-6f52-47de-ac54-aeb0e392fb08 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.217606 Oct 28 19:06:49.420027 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 62/120] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:49 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:49.941650 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-cc70edcf-4371-4315-9e89-2c6b0802073e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:49.942248 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-cc70edcf-4371-4315-9e89-2c6b0802073e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:49.948131 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cc70edcf-4371-4315-9e89-2c6b0802073e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:49.948611 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cc70edcf-4371-4315-9e89-2c6b0802073e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:49.949039 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cc70edcf-4371-4315-9e89-2c6b0802073e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:49.949717 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cc70edcf-4371-4315-9e89-2c6b0802073e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:49.950160 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cc70edcf-4371-4315-9e89-2c6b0802073e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:49.950580 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cc70edcf-4371-4315-9e89-2c6b0802073e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:50.074115 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-cc70edcf-4371-4315-9e89-2c6b0802073e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:50.082235 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-cc70edcf-4371-4315-9e89-2c6b0802073e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.144492 Oct 28 19:06:50.082797 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 59/121] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:49 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:50.115450 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f007179c-1a3f-4cec-8300-d04af136aec4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:50.116051 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f007179c-1a3f-4cec-8300-d04af136aec4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:50.121988 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f007179c-1a3f-4cec-8300-d04af136aec4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:50.122464 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f007179c-1a3f-4cec-8300-d04af136aec4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:50.122896 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f007179c-1a3f-4cec-8300-d04af136aec4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:50.123615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f007179c-1a3f-4cec-8300-d04af136aec4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:50.124063 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f007179c-1a3f-4cec-8300-d04af136aec4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:50.124489 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f007179c-1a3f-4cec-8300-d04af136aec4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:50.252059 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f007179c-1a3f-4cec-8300-d04af136aec4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:50.259707 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f007179c-1a3f-4cec-8300-d04af136aec4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.148046 Oct 28 19:06:50.260278 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 63/122] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:50 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:50.441624 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-68483297-f623-4dd2-b3f0-962aeeaca88b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:50.442224 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-68483297-f623-4dd2-b3f0-962aeeaca88b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:50.448137 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-68483297-f623-4dd2-b3f0-962aeeaca88b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:50.448613 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-68483297-f623-4dd2-b3f0-962aeeaca88b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:50.449043 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-68483297-f623-4dd2-b3f0-962aeeaca88b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:50.449728 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-68483297-f623-4dd2-b3f0-962aeeaca88b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:50.450171 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-68483297-f623-4dd2-b3f0-962aeeaca88b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:50.450588 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-68483297-f623-4dd2-b3f0-962aeeaca88b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:50.592245 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-68483297-f623-4dd2-b3f0-962aeeaca88b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:50.600521 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-68483297-f623-4dd2-b3f0-962aeeaca88b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.162691 Oct 28 19:06:50.601116 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 60/123] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:50 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:51.105333 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-817d3b85-60c3-47de-95cd-e829d10c133c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:51.106085 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-817d3b85-60c3-47de-95cd-e829d10c133c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:51.113317 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-817d3b85-60c3-47de-95cd-e829d10c133c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:51.114074 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-817d3b85-60c3-47de-95cd-e829d10c133c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:51.114513 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-817d3b85-60c3-47de-95cd-e829d10c133c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:51.115239 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-817d3b85-60c3-47de-95cd-e829d10c133c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:51.115692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-817d3b85-60c3-47de-95cd-e829d10c133c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:51.116256 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-817d3b85-60c3-47de-95cd-e829d10c133c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:51.257086 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-817d3b85-60c3-47de-95cd-e829d10c133c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:51.265271 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-817d3b85-60c3-47de-95cd-e829d10c133c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.163576 Oct 28 19:06:51.265833 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 64/124] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:51 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:51.283294 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-ac03cd22-20be-4473-b170-75d3794c4f22 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:51.283901 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-ac03cd22-20be-4473-b170-75d3794c4f22 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:51.289851 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ac03cd22-20be-4473-b170-75d3794c4f22 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:51.290281 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ac03cd22-20be-4473-b170-75d3794c4f22 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:51.290797 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ac03cd22-20be-4473-b170-75d3794c4f22 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:51.291420 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ac03cd22-20be-4473-b170-75d3794c4f22 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:51.291865 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ac03cd22-20be-4473-b170-75d3794c4f22 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:51.292421 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ac03cd22-20be-4473-b170-75d3794c4f22 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:51.419660 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ac03cd22-20be-4473-b170-75d3794c4f22 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:51.427770 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-ac03cd22-20be-4473-b170-75d3794c4f22 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.148880 Oct 28 19:06:51.428335 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 61/125] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:51 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:51.625224 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-e671a2f9-56ab-4f95-86a0-04aeb4fd027b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:51.625840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-e671a2f9-56ab-4f95-86a0-04aeb4fd027b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:51.636521 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e671a2f9-56ab-4f95-86a0-04aeb4fd027b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:51.637352 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e671a2f9-56ab-4f95-86a0-04aeb4fd027b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:51.637800 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e671a2f9-56ab-4f95-86a0-04aeb4fd027b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:51.638560 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e671a2f9-56ab-4f95-86a0-04aeb4fd027b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:51.639047 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e671a2f9-56ab-4f95-86a0-04aeb4fd027b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:51.639533 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e671a2f9-56ab-4f95-86a0-04aeb4fd027b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:51.733099 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-2e898a91-011a-40ca-8638-e96ead164c3d req-acc2ab90-9952-4a4e-bfba-36aca95df798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48109dc7-b13e-4e6f-ad81-fd2e296fce62", "name": "network-vif-plugged", "status": "completed", "tag": "ef2ab85a-6668-4509-8eda-8a1c2af741e2"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:51.742821 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-2e898a91-011a-40ca-8638-e96ead164c3d req-acc2ab90-9952-4a4e-bfba-36aca95df798 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:51.743552 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-2e898a91-011a-40ca-8638-e96ead164c3d req-acc2ab90-9952-4a4e-bfba-36aca95df798 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:51.743968 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-2e898a91-011a-40ca-8638-e96ead164c3d req-acc2ab90-9952-4a4e-bfba-36aca95df798 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:51.758036 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-2e898a91-011a-40ca-8638-e96ead164c3d req-acc2ab90-9952-4a4e-bfba-36aca95df798 service nova] Creating event network-vif-plugged:ef2ab85a-6668-4509-8eda-8a1c2af741e2 for instance 48109dc7-b13e-4e6f-ad81-fd2e296fce62 on hv-cinder-86236 Oct 28 19:06:51.763962 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-2e898a91-011a-40ca-8638-e96ead164c3d req-acc2ab90-9952-4a4e-bfba-36aca95df798 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034789 Oct 28 19:06:51.764569 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 62/126] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:06:51.793156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e671a2f9-56ab-4f95-86a0-04aeb4fd027b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:51.801221 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-e671a2f9-56ab-4f95-86a0-04aeb4fd027b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.180146 Oct 28 19:06:51.801788 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 65/127] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:51 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:52.288698 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-8b81af70-c4ed-4232-830b-d8eb51552043 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:52.289384 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-8b81af70-c4ed-4232-830b-d8eb51552043 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:52.295664 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8b81af70-c4ed-4232-830b-d8eb51552043 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:52.296152 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8b81af70-c4ed-4232-830b-d8eb51552043 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:52.296593 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8b81af70-c4ed-4232-830b-d8eb51552043 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:52.297314 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8b81af70-c4ed-4232-830b-d8eb51552043 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:52.297767 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8b81af70-c4ed-4232-830b-d8eb51552043 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:52.298881 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8b81af70-c4ed-4232-830b-d8eb51552043 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:52.426252 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-8b81af70-c4ed-4232-830b-d8eb51552043 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:52.433926 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-8b81af70-c4ed-4232-830b-d8eb51552043 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.149374 Oct 28 19:06:52.434487 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 63/128] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:52 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:52.449705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-91d53c92-f2da-4551-bbc7-da6b5a35223a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:52.450310 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-91d53c92-f2da-4551-bbc7-da6b5a35223a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:52.456838 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-91d53c92-f2da-4551-bbc7-da6b5a35223a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:52.457308 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-91d53c92-f2da-4551-bbc7-da6b5a35223a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:52.457811 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-91d53c92-f2da-4551-bbc7-da6b5a35223a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:52.458650 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-91d53c92-f2da-4551-bbc7-da6b5a35223a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:52.459464 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-91d53c92-f2da-4551-bbc7-da6b5a35223a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:52.459972 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-91d53c92-f2da-4551-bbc7-da6b5a35223a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:52.585052 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-91d53c92-f2da-4551-bbc7-da6b5a35223a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:52.592809 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-91d53c92-f2da-4551-bbc7-da6b5a35223a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.146838 Oct 28 19:06:52.593369 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 66/129] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:52 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:52.823818 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-3e5c6e52-da20-4ad6-86ec-e759699df35d tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:52.824417 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-3e5c6e52-da20-4ad6-86ec-e759699df35d tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:52.831227 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3e5c6e52-da20-4ad6-86ec-e759699df35d tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:52.831703 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3e5c6e52-da20-4ad6-86ec-e759699df35d tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:52.832132 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3e5c6e52-da20-4ad6-86ec-e759699df35d tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:52.832827 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3e5c6e52-da20-4ad6-86ec-e759699df35d tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:52.833247 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3e5c6e52-da20-4ad6-86ec-e759699df35d tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:52.833733 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3e5c6e52-da20-4ad6-86ec-e759699df35d tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:52.960800 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3e5c6e52-da20-4ad6-86ec-e759699df35d tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:52.968256 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-3e5c6e52-da20-4ad6-86ec-e759699df35d tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.148280 Oct 28 19:06:52.968815 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 64/130] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:52 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:53.456375 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-6c881bc3-f90f-4ae9-8430-b7275dd48a71 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:53.457057 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-6c881bc3-f90f-4ae9-8430-b7275dd48a71 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:53.465317 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6c881bc3-f90f-4ae9-8430-b7275dd48a71 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:53.465812 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6c881bc3-f90f-4ae9-8430-b7275dd48a71 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:53.466255 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6c881bc3-f90f-4ae9-8430-b7275dd48a71 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:53.467115 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6c881bc3-f90f-4ae9-8430-b7275dd48a71 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:53.467558 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6c881bc3-f90f-4ae9-8430-b7275dd48a71 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:53.467981 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6c881bc3-f90f-4ae9-8430-b7275dd48a71 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:53.599122 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-6c881bc3-f90f-4ae9-8430-b7275dd48a71 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:53.606797 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-6c881bc3-f90f-4ae9-8430-b7275dd48a71 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.154572 Oct 28 19:06:53.607387 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 67/131] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:53 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:53.620316 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c9d9db18-6fc8-4b7c-840f-49fb2c6a97ba tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:53.621023 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-c9d9db18-6fc8-4b7c-840f-49fb2c6a97ba tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:53.627345 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c9d9db18-6fc8-4b7c-840f-49fb2c6a97ba tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:53.627895 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c9d9db18-6fc8-4b7c-840f-49fb2c6a97ba tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:53.628334 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c9d9db18-6fc8-4b7c-840f-49fb2c6a97ba tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:53.629027 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c9d9db18-6fc8-4b7c-840f-49fb2c6a97ba tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:53.629481 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c9d9db18-6fc8-4b7c-840f-49fb2c6a97ba tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:53.629906 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c9d9db18-6fc8-4b7c-840f-49fb2c6a97ba tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:53.758275 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c9d9db18-6fc8-4b7c-840f-49fb2c6a97ba tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:53.766164 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-c9d9db18-6fc8-4b7c-840f-49fb2c6a97ba tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.153658 Oct 28 19:06:53.766722 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 65/132] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:53 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:53.991400 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-0b273eba-3a95-4d75-a10b-2142cd44e10f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:53.992003 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-0b273eba-3a95-4d75-a10b-2142cd44e10f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:53.997804 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0b273eba-3a95-4d75-a10b-2142cd44e10f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:53.998277 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0b273eba-3a95-4d75-a10b-2142cd44e10f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:53.998711 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0b273eba-3a95-4d75-a10b-2142cd44e10f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:53.999413 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0b273eba-3a95-4d75-a10b-2142cd44e10f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:53.999859 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0b273eba-3a95-4d75-a10b-2142cd44e10f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:54.000283 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0b273eba-3a95-4d75-a10b-2142cd44e10f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:54.124693 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-0b273eba-3a95-4d75-a10b-2142cd44e10f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:54.132768 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-0b273eba-3a95-4d75-a10b-2142cd44e10f tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.145483 Oct 28 19:06:54.133330 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 68/133] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:53 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:54.629497 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-fbcfb18f-d32d-4c5e-95eb-69a12b2a35db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:54.630096 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-fbcfb18f-d32d-4c5e-95eb-69a12b2a35db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:54.635986 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fbcfb18f-d32d-4c5e-95eb-69a12b2a35db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:54.636465 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fbcfb18f-d32d-4c5e-95eb-69a12b2a35db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:54.637167 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fbcfb18f-d32d-4c5e-95eb-69a12b2a35db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:54.637847 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fbcfb18f-d32d-4c5e-95eb-69a12b2a35db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:54.638301 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fbcfb18f-d32d-4c5e-95eb-69a12b2a35db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:54.638726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fbcfb18f-d32d-4c5e-95eb-69a12b2a35db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:54.775461 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-fbcfb18f-d32d-4c5e-95eb-69a12b2a35db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:54.785091 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-fbcfb18f-d32d-4c5e-95eb-69a12b2a35db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.159347 Oct 28 19:06:54.785921 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 66/134] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:54 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:54.788722 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-b018a029-de3e-4811-8e23-f706a292323d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:54.789866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-b018a029-de3e-4811-8e23-f706a292323d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:54.796356 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b018a029-de3e-4811-8e23-f706a292323d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:54.796824 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b018a029-de3e-4811-8e23-f706a292323d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:54.797506 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b018a029-de3e-4811-8e23-f706a292323d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:54.798279 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b018a029-de3e-4811-8e23-f706a292323d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:54.798727 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b018a029-de3e-4811-8e23-f706a292323d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:54.799182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b018a029-de3e-4811-8e23-f706a292323d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:54.930854 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-b018a029-de3e-4811-8e23-f706a292323d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:54.938601 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-b018a029-de3e-4811-8e23-f706a292323d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.153711 Oct 28 19:06:54.939189 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 69/135] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:54 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:06:55.155690 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-fe6fd2d2-c423-4e32-b461-1cd66b6ff24b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:55.156193 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-fe6fd2d2-c423-4e32-b461-1cd66b6ff24b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:55.162069 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fe6fd2d2-c423-4e32-b461-1cd66b6ff24b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:55.162561 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fe6fd2d2-c423-4e32-b461-1cd66b6ff24b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:55.163022 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fe6fd2d2-c423-4e32-b461-1cd66b6ff24b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:55.163718 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fe6fd2d2-c423-4e32-b461-1cd66b6ff24b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:55.164173 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fe6fd2d2-c423-4e32-b461-1cd66b6ff24b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:55.164594 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fe6fd2d2-c423-4e32-b461-1cd66b6ff24b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:55.294621 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-fe6fd2d2-c423-4e32-b461-1cd66b6ff24b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:55.302322 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-fe6fd2d2-c423-4e32-b461-1cd66b6ff24b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1314 microversion: 2.1 time: 0.150707 Oct 28 19:06:55.302886 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 67/136] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:55 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:55.807870 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-0f6a16c8-84c6-4c73-99dc-6600094ebe8a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:55.808534 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-0f6a16c8-84c6-4c73-99dc-6600094ebe8a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:55.814709 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0f6a16c8-84c6-4c73-99dc-6600094ebe8a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:55.815341 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0f6a16c8-84c6-4c73-99dc-6600094ebe8a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:55.815848 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0f6a16c8-84c6-4c73-99dc-6600094ebe8a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:55.816688 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0f6a16c8-84c6-4c73-99dc-6600094ebe8a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:55.817141 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0f6a16c8-84c6-4c73-99dc-6600094ebe8a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:55.817566 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0f6a16c8-84c6-4c73-99dc-6600094ebe8a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:55.949295 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-0f6a16c8-84c6-4c73-99dc-6600094ebe8a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:55.952719 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=100 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:55.958183 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-0f6a16c8-84c6-4c73-99dc-6600094ebe8a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.154098 Oct 28 19:06:55.958922 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 70/137] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:55 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:55.961911 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-f90dce3a-d732-4ea7-8a76-52c0f6c1e67f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:55.963533 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-f90dce3a-d732-4ea7-8a76-52c0f6c1e67f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:55.971930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f90dce3a-d732-4ea7-8a76-52c0f6c1e67f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:55.972593 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f90dce3a-d732-4ea7-8a76-52c0f6c1e67f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:55.973294 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f90dce3a-d732-4ea7-8a76-52c0f6c1e67f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:55.974221 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f90dce3a-d732-4ea7-8a76-52c0f6c1e67f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:55.975745 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f90dce3a-d732-4ea7-8a76-52c0f6c1e67f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:55.976219 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f90dce3a-d732-4ea7-8a76-52c0f6c1e67f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:55.996629 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=100 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:56.118373 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-f90dce3a-d732-4ea7-8a76-52c0f6c1e67f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:56.126136 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-f90dce3a-d732-4ea7-8a76-52c0f6c1e67f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.168567 Oct 28 19:06:56.126888 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 68/138] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:55 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:56.325598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-de579587-8a66-4fc2-a65e-6bfa38948a4b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:56.326222 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-de579587-8a66-4fc2-a65e-6bfa38948a4b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:56.333213 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-de579587-8a66-4fc2-a65e-6bfa38948a4b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:56.333692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-de579587-8a66-4fc2-a65e-6bfa38948a4b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:56.334123 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-de579587-8a66-4fc2-a65e-6bfa38948a4b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:56.334804 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-de579587-8a66-4fc2-a65e-6bfa38948a4b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:56.335350 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-de579587-8a66-4fc2-a65e-6bfa38948a4b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:56.335769 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-de579587-8a66-4fc2-a65e-6bfa38948a4b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:56.463537 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-de579587-8a66-4fc2-a65e-6bfa38948a4b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:56.471832 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-de579587-8a66-4fc2-a65e-6bfa38948a4b tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1501 microversion: 2.1 time: 0.150026 Oct 28 19:06:56.472329 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 71/139] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:56 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1501 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:56.987815 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-263f9cc2-2eae-4cae-a3de-1d77ce78d9f6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:56.989480 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-263f9cc2-2eae-4cae-a3de-1d77ce78d9f6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:56.999558 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_api:SELECT=96 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:57.002047 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-263f9cc2-2eae-4cae-a3de-1d77ce78d9f6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:57.002897 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-263f9cc2-2eae-4cae-a3de-1d77ce78d9f6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:57.003798 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-263f9cc2-2eae-4cae-a3de-1d77ce78d9f6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:57.004806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-263f9cc2-2eae-4cae-a3de-1d77ce78d9f6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:57.005419 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-263f9cc2-2eae-4cae-a3de-1d77ce78d9f6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:57.005913 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-263f9cc2-2eae-4cae-a3de-1d77ce78d9f6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:57.150657 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-5ea72133-1cfa-4020-953e-3c0bc06feb1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:57.152195 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-5ea72133-1cfa-4020-953e-3c0bc06feb1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:57.166038 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5ea72133-1cfa-4020-953e-3c0bc06feb1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:57.166973 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5ea72133-1cfa-4020-953e-3c0bc06feb1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:57.167692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5ea72133-1cfa-4020-953e-3c0bc06feb1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:57.168639 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5ea72133-1cfa-4020-953e-3c0bc06feb1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:57.169439 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5ea72133-1cfa-4020-953e-3c0bc06feb1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:57.170283 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5ea72133-1cfa-4020-953e-3c0bc06feb1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:57.334225 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-263f9cc2-2eae-4cae-a3de-1d77ce78d9f6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:57.342438 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-263f9cc2-2eae-4cae-a3de-1d77ce78d9f6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.362148 Oct 28 19:06:57.343029 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 69/140] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:56 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:57.414014 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-5ea72133-1cfa-4020-953e-3c0bc06feb1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:57.422035 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-5ea72133-1cfa-4020-953e-3c0bc06feb1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.275148 Oct 28 19:06:57.423394 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 72/141] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:57 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:57.874228 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-31729166-488e-4cf5-8535-9b9f7a9ca0e1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "945d91ba-95cf-4559-8e0e-42bb7d12204d"}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:57.877485 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-31729166-488e-4cf5-8535-9b9f7a9ca0e1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:57.887574 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-31729166-488e-4cf5-8535-9b9f7a9ca0e1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:57.888071 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-31729166-488e-4cf5-8535-9b9f7a9ca0e1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:57.888505 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-31729166-488e-4cf5-8535-9b9f7a9ca0e1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:57.889203 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-31729166-488e-4cf5-8535-9b9f7a9ca0e1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:57.889648 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-31729166-488e-4cf5-8535-9b9f7a9ca0e1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:57.890267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-31729166-488e-4cf5-8535-9b9f7a9ca0e1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:58.365625 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-5c9ca106-97f4-45ff-ad7a-85603c6639ca tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:58.366229 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-5c9ca106-97f4-45ff-ad7a-85603c6639ca tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:58.376136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c9ca106-97f4-45ff-ad7a-85603c6639ca tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:58.377013 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c9ca106-97f4-45ff-ad7a-85603c6639ca tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:58.377608 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c9ca106-97f4-45ff-ad7a-85603c6639ca tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:58.378305 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c9ca106-97f4-45ff-ad7a-85603c6639ca tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:58.378750 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c9ca106-97f4-45ff-ad7a-85603c6639ca tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:58.379391 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c9ca106-97f4-45ff-ad7a-85603c6639ca tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:58.512504 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-5c9ca106-97f4-45ff-ad7a-85603c6639ca tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:58.521010 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-5c9ca106-97f4-45ff-ad7a-85603c6639ca tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.159152 Oct 28 19:06:58.521660 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 73/142] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:58 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:06:58.526689 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-3707ff84-3285-49a1-9e61-33d61557fa2e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:58.527496 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-3707ff84-3285-49a1-9e61-33d61557fa2e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:58.534291 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3707ff84-3285-49a1-9e61-33d61557fa2e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:58.534705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3707ff84-3285-49a1-9e61-33d61557fa2e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:58.535467 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3707ff84-3285-49a1-9e61-33d61557fa2e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:58.537173 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3707ff84-3285-49a1-9e61-33d61557fa2e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:58.537746 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3707ff84-3285-49a1-9e61-33d61557fa2e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:58.538370 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3707ff84-3285-49a1-9e61-33d61557fa2e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:58.689462 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3707ff84-3285-49a1-9e61-33d61557fa2e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:58.695775 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-3707ff84-3285-49a1-9e61-33d61557fa2e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.172958 Oct 28 19:06:58.696417 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 74/143] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:58 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:59.544552 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4062a048-2088-41e5-bfc1-c73522184a29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:59.545182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-4062a048-2088-41e5-bfc1-c73522184a29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:59.551602 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4062a048-2088-41e5-bfc1-c73522184a29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:59.552079 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4062a048-2088-41e5-bfc1-c73522184a29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:59.552515 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4062a048-2088-41e5-bfc1-c73522184a29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:59.553198 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4062a048-2088-41e5-bfc1-c73522184a29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:59.553646 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4062a048-2088-41e5-bfc1-c73522184a29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:59.554068 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4062a048-2088-41e5-bfc1-c73522184a29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:59.688063 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4062a048-2088-41e5-bfc1-c73522184a29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:59.695876 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-4062a048-2088-41e5-bfc1-c73522184a29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.155205 Oct 28 19:06:59.696451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 75/144] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:59 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:06:59.725880 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-32e1ec04-1708-47ab-aab9-277e55d7f41f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:59.727182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-32e1ec04-1708-47ab-aab9-277e55d7f41f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:59.742043 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32e1ec04-1708-47ab-aab9-277e55d7f41f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:59.742828 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32e1ec04-1708-47ab-aab9-277e55d7f41f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:59.743339 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32e1ec04-1708-47ab-aab9-277e55d7f41f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:59.744070 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32e1ec04-1708-47ab-aab9-277e55d7f41f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:59.744526 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32e1ec04-1708-47ab-aab9-277e55d7f41f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:59.744955 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32e1ec04-1708-47ab-aab9-277e55d7f41f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:59.882374 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-32e1ec04-1708-47ab-aab9-277e55d7f41f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:59.893027 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-32e1ec04-1708-47ab-aab9-277e55d7f41f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.170682 Oct 28 19:06:59.893593 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 76/145] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:59 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:00.718612 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-37e6727c-5956-4506-988e-a7ec621f84f5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:00.719343 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-37e6727c-5956-4506-988e-a7ec621f84f5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:00.725469 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-37e6727c-5956-4506-988e-a7ec621f84f5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:00.725954 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-37e6727c-5956-4506-988e-a7ec621f84f5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:00.726428 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-37e6727c-5956-4506-988e-a7ec621f84f5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:00.727271 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-37e6727c-5956-4506-988e-a7ec621f84f5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:00.727762 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-37e6727c-5956-4506-988e-a7ec621f84f5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:00.728194 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-37e6727c-5956-4506-988e-a7ec621f84f5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:00.877550 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-37e6727c-5956-4506-988e-a7ec621f84f5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:00.885281 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-37e6727c-5956-4506-988e-a7ec621f84f5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.170483 Oct 28 19:07:00.885779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 77/146] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:00 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:00.915831 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-14895124-0868-40de-9554-468cb0ae5708 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:00.916495 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-14895124-0868-40de-9554-468cb0ae5708 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:00.925452 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-14895124-0868-40de-9554-468cb0ae5708 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:00.925947 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-14895124-0868-40de-9554-468cb0ae5708 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:00.926547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-14895124-0868-40de-9554-468cb0ae5708 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:00.927865 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-14895124-0868-40de-9554-468cb0ae5708 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:00.927865 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-14895124-0868-40de-9554-468cb0ae5708 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:00.928331 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-14895124-0868-40de-9554-468cb0ae5708 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:01.070530 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-14895124-0868-40de-9554-468cb0ae5708 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:01.078587 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-14895124-0868-40de-9554-468cb0ae5708 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.166589 Oct 28 19:07:01.079206 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 78/147] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:00 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:07:01.910438 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-ee7196ab-4125-496a-97f4-c8612a096da2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:01.912007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-ee7196ab-4125-496a-97f4-c8612a096da2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:01.921450 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ee7196ab-4125-496a-97f4-c8612a096da2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:01.922271 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ee7196ab-4125-496a-97f4-c8612a096da2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:01.922936 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ee7196ab-4125-496a-97f4-c8612a096da2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:01.923861 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ee7196ab-4125-496a-97f4-c8612a096da2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:01.924495 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ee7196ab-4125-496a-97f4-c8612a096da2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:01.925101 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ee7196ab-4125-496a-97f4-c8612a096da2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:02.114456 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ee7196ab-4125-496a-97f4-c8612a096da2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:02.126521 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-ee7196ab-4125-496a-97f4-c8612a096da2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.219974 Oct 28 19:07:02.127978 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 79/148] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:01 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:07:02.147021 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-b81c80ed-bc69-47e9-b569-df4b300c4a4c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:02.147813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-b81c80ed-bc69-47e9-b569-df4b300c4a4c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:02.156040 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b81c80ed-bc69-47e9-b569-df4b300c4a4c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:02.157035 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b81c80ed-bc69-47e9-b569-df4b300c4a4c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:02.157478 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b81c80ed-bc69-47e9-b569-df4b300c4a4c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:02.158805 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b81c80ed-bc69-47e9-b569-df4b300c4a4c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:02.159731 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b81c80ed-bc69-47e9-b569-df4b300c4a4c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:02.160458 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b81c80ed-bc69-47e9-b569-df4b300c4a4c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:02.328299 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-b81c80ed-bc69-47e9-b569-df4b300c4a4c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:02.338466 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-b81c80ed-bc69-47e9-b569-df4b300c4a4c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.208479 Oct 28 19:07:02.339222 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 80/149] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:02 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:02.435953 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-31729166-488e-4cf5-8535-9b9f7a9ca0e1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "POST /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.565548 Oct 28 19:07:02.437168 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 70/150] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Oct 28 19:06:57 2022] POST /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f/os-volume_attachments => generated 194 bytes in 4568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:03.152987 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-06da681b-3145-472e-a816-92bd8911d210 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:03.153691 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-06da681b-3145-472e-a816-92bd8911d210 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:03.160287 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-06da681b-3145-472e-a816-92bd8911d210 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:03.160845 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-06da681b-3145-472e-a816-92bd8911d210 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:03.161462 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-06da681b-3145-472e-a816-92bd8911d210 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:03.162154 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-06da681b-3145-472e-a816-92bd8911d210 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:03.162607 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-06da681b-3145-472e-a816-92bd8911d210 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:03.163058 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-06da681b-3145-472e-a816-92bd8911d210 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:03.304706 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-06da681b-3145-472e-a816-92bd8911d210 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:03.312380 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-06da681b-3145-472e-a816-92bd8911d210 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.163253 Oct 28 19:07:03.313674 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 81/151] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:03 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:03.362685 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b1bd8792-c4da-46db-a333-0e40ead8ba91 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:03.363408 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b1bd8792-c4da-46db-a333-0e40ead8ba91 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:03.369424 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b1bd8792-c4da-46db-a333-0e40ead8ba91 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:03.369964 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b1bd8792-c4da-46db-a333-0e40ead8ba91 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:03.370394 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b1bd8792-c4da-46db-a333-0e40ead8ba91 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:03.371115 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b1bd8792-c4da-46db-a333-0e40ead8ba91 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:03.371564 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b1bd8792-c4da-46db-a333-0e40ead8ba91 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:03.371984 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b1bd8792-c4da-46db-a333-0e40ead8ba91 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:03.686881 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b1bd8792-c4da-46db-a333-0e40ead8ba91 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:03.696164 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b1bd8792-c4da-46db-a333-0e40ead8ba91 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.338190 Oct 28 19:07:03.696735 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 71/152] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:03 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:04.351204 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-ad79d5eb-4650-42f5-a4cb-bde16a079759 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:04.351820 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-ad79d5eb-4650-42f5-a4cb-bde16a079759 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:04.357702 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ad79d5eb-4650-42f5-a4cb-bde16a079759 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:04.358191 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ad79d5eb-4650-42f5-a4cb-bde16a079759 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:04.358635 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ad79d5eb-4650-42f5-a4cb-bde16a079759 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:04.359353 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ad79d5eb-4650-42f5-a4cb-bde16a079759 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:04.360595 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ad79d5eb-4650-42f5-a4cb-bde16a079759 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:04.361036 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ad79d5eb-4650-42f5-a4cb-bde16a079759 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:04.488703 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ad79d5eb-4650-42f5-a4cb-bde16a079759 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:04.496524 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-ad79d5eb-4650-42f5-a4cb-bde16a079759 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.164300 Oct 28 19:07:04.497087 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 82/153] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:04 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:04.717794 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-adfea2c0-a652-4f8f-a40e-e89847ec0162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:04.718477 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-adfea2c0-a652-4f8f-a40e-e89847ec0162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:04.725743 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-adfea2c0-a652-4f8f-a40e-e89847ec0162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:04.726315 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-adfea2c0-a652-4f8f-a40e-e89847ec0162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:04.727008 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-adfea2c0-a652-4f8f-a40e-e89847ec0162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:04.727780 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-adfea2c0-a652-4f8f-a40e-e89847ec0162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:04.728305 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-adfea2c0-a652-4f8f-a40e-e89847ec0162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:04.728802 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-adfea2c0-a652-4f8f-a40e-e89847ec0162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:04.870302 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-adfea2c0-a652-4f8f-a40e-e89847ec0162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:04.877919 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-adfea2c0-a652-4f8f-a40e-e89847ec0162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1322 microversion: 2.1 time: 0.164181 Oct 28 19:07:04.878475 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 72/154] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:04 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:05.521299 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-94a3a848-798c-4d52-9e06-e66f5be15f16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:05.521902 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-94a3a848-798c-4d52-9e06-e66f5be15f16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:05.527817 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-94a3a848-798c-4d52-9e06-e66f5be15f16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:05.528292 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-94a3a848-798c-4d52-9e06-e66f5be15f16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:05.528727 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-94a3a848-798c-4d52-9e06-e66f5be15f16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:05.529403 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-94a3a848-798c-4d52-9e06-e66f5be15f16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:05.529851 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-94a3a848-798c-4d52-9e06-e66f5be15f16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:05.530267 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-94a3a848-798c-4d52-9e06-e66f5be15f16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:05.661064 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-94a3a848-798c-4d52-9e06-e66f5be15f16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:05.669404 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-94a3a848-798c-4d52-9e06-e66f5be15f16 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.151647 Oct 28 19:07:05.670394 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 83/155] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:05 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:05.900552 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-253f9501-debe-4e84-9e1c-bda7f3c06cb6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:05.904733 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-253f9501-debe-4e84-9e1c-bda7f3c06cb6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:05.908184 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-253f9501-debe-4e84-9e1c-bda7f3c06cb6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:05.908665 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-253f9501-debe-4e84-9e1c-bda7f3c06cb6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:05.909096 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-253f9501-debe-4e84-9e1c-bda7f3c06cb6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:05.909783 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-253f9501-debe-4e84-9e1c-bda7f3c06cb6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:05.910227 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-253f9501-debe-4e84-9e1c-bda7f3c06cb6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:05.910642 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-253f9501-debe-4e84-9e1c-bda7f3c06cb6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:06.036608 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-253f9501-debe-4e84-9e1c-bda7f3c06cb6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:06.044188 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-253f9501-debe-4e84-9e1c-bda7f3c06cb6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1516 microversion: 2.1 time: 0.147431 Oct 28 19:07:06.044744 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 73/156] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:05 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:06.067665 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-9f3669c7-3559-49cd-abaa-391f6b78623f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:06.069978 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-9f3669c7-3559-49cd-abaa-391f6b78623f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:06.075860 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9f3669c7-3559-49cd-abaa-391f6b78623f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:06.076335 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9f3669c7-3559-49cd-abaa-391f6b78623f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:06.076767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9f3669c7-3559-49cd-abaa-391f6b78623f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:06.077450 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9f3669c7-3559-49cd-abaa-391f6b78623f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:06.077894 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9f3669c7-3559-49cd-abaa-391f6b78623f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:06.078314 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9f3669c7-3559-49cd-abaa-391f6b78623f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:06.100983 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.objects.instance [None req-9f3669c7-3559-49cd-abaa-391f6b78623f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lazy-loading 'flavor' on Instance uuid 48109dc7-b13e-4e6f-ad81-fd2e296fce62 {{(pid=118874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:07:06.211698 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-9f3669c7-3559-49cd-abaa-391f6b78623f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "POST /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62/action" status: 200 len: 32 microversion: 2.1 time: 0.148509 Oct 28 19:07:06.212287 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 84/157] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Oct 28 19:07:06 2022] POST /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62/action => generated 32 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:06.222104 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-94984f0d-c7a1-4df2-92b6-3cf021e22884 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:06.222712 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-94984f0d-c7a1-4df2-92b6-3cf021e22884 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:06.228585 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-94984f0d-c7a1-4df2-92b6-3cf021e22884 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:06.229066 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-94984f0d-c7a1-4df2-92b6-3cf021e22884 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:06.229504 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-94984f0d-c7a1-4df2-92b6-3cf021e22884 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:06.230186 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-94984f0d-c7a1-4df2-92b6-3cf021e22884 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:06.230667 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-94984f0d-c7a1-4df2-92b6-3cf021e22884 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:06.231117 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-94984f0d-c7a1-4df2-92b6-3cf021e22884 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:06.361080 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-94984f0d-c7a1-4df2-92b6-3cf021e22884 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:06.368752 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-94984f0d-c7a1-4df2-92b6-3cf021e22884 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.150984 Oct 28 19:07:06.369326 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 74/158] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:06 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:06.693828 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-6d0e5891-ce00-4f18-8c45-2cb20fdc40db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:06.694509 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-6d0e5891-ce00-4f18-8c45-2cb20fdc40db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:06.700824 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6d0e5891-ce00-4f18-8c45-2cb20fdc40db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:06.701156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6d0e5891-ce00-4f18-8c45-2cb20fdc40db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:06.701599 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6d0e5891-ce00-4f18-8c45-2cb20fdc40db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:06.702292 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6d0e5891-ce00-4f18-8c45-2cb20fdc40db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:06.702751 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6d0e5891-ce00-4f18-8c45-2cb20fdc40db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:06.703211 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6d0e5891-ce00-4f18-8c45-2cb20fdc40db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:06.721073 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:06.840829 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-6d0e5891-ce00-4f18-8c45-2cb20fdc40db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:06.849106 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-6d0e5891-ce00-4f18-8c45-2cb20fdc40db tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.159715 Oct 28 19:07:06.849674 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 85/159] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:06 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:07.392145 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-1a84feab-ebe6-4f4c-836d-e818452886f3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:07.392740 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-1a84feab-ebe6-4f4c-836d-e818452886f3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:07.399061 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1a84feab-ebe6-4f4c-836d-e818452886f3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:07.399540 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1a84feab-ebe6-4f4c-836d-e818452886f3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:07.399973 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1a84feab-ebe6-4f4c-836d-e818452886f3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:07.400681 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1a84feab-ebe6-4f4c-836d-e818452886f3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:07.401126 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1a84feab-ebe6-4f4c-836d-e818452886f3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:07.401543 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1a84feab-ebe6-4f4c-836d-e818452886f3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:07.532686 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1a84feab-ebe6-4f4c-836d-e818452886f3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:07.540310 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-1a84feab-ebe6-4f4c-836d-e818452886f3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.152323 Oct 28 19:07:07.540871 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 75/160] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:07 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:07.871518 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-9db527f3-1174-4103-bc7b-7a092dda6fc2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:07.872117 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-9db527f3-1174-4103-bc7b-7a092dda6fc2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:07.878596 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9db527f3-1174-4103-bc7b-7a092dda6fc2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:07.879054 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9db527f3-1174-4103-bc7b-7a092dda6fc2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:07.879487 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9db527f3-1174-4103-bc7b-7a092dda6fc2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:07.880166 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9db527f3-1174-4103-bc7b-7a092dda6fc2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:07.880608 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9db527f3-1174-4103-bc7b-7a092dda6fc2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:07.881025 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9db527f3-1174-4103-bc7b-7a092dda6fc2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:08.009349 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-9db527f3-1174-4103-bc7b-7a092dda6fc2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:08.017811 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-9db527f3-1174-4103-bc7b-7a092dda6fc2 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.150036 Oct 28 19:07:08.018382 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 86/161] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:07 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:08.563379 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-115f6cc0-13b7-4332-87f2-b6eb2cc0f46c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:08.563982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-115f6cc0-13b7-4332-87f2-b6eb2cc0f46c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:08.570260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-115f6cc0-13b7-4332-87f2-b6eb2cc0f46c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:08.570731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-115f6cc0-13b7-4332-87f2-b6eb2cc0f46c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:08.571194 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-115f6cc0-13b7-4332-87f2-b6eb2cc0f46c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:08.571870 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-115f6cc0-13b7-4332-87f2-b6eb2cc0f46c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:08.572353 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-115f6cc0-13b7-4332-87f2-b6eb2cc0f46c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:08.572770 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-115f6cc0-13b7-4332-87f2-b6eb2cc0f46c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:08.700480 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-115f6cc0-13b7-4332-87f2-b6eb2cc0f46c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:08.708345 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-115f6cc0-13b7-4332-87f2-b6eb2cc0f46c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.148839 Oct 28 19:07:08.708912 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 76/162] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:08 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:09.039608 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-e33ab6c1-bbe6-47e3-ad89-9d4b7bc1fa0f tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:09.040212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-e33ab6c1-bbe6-47e3-ad89-9d4b7bc1fa0f tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:09.043127 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=88 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:09.046866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e33ab6c1-bbe6-47e3-ad89-9d4b7bc1fa0f tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:09.047368 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e33ab6c1-bbe6-47e3-ad89-9d4b7bc1fa0f tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:09.047842 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e33ab6c1-bbe6-47e3-ad89-9d4b7bc1fa0f tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:09.048527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e33ab6c1-bbe6-47e3-ad89-9d4b7bc1fa0f tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:09.048982 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e33ab6c1-bbe6-47e3-ad89-9d4b7bc1fa0f tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:09.049414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e33ab6c1-bbe6-47e3-ad89-9d4b7bc1fa0f tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:09.179933 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e33ab6c1-bbe6-47e3-ad89-9d4b7bc1fa0f tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:09.187538 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-e33ab6c1-bbe6-47e3-ad89-9d4b7bc1fa0f tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.151725 Oct 28 19:07:09.188099 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 87/163] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:09 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:09.732954 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-256c661d-f47c-491a-8a1f-87a9bcbbe3c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:09.733553 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-256c661d-f47c-491a-8a1f-87a9bcbbe3c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:09.744637 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-75b1f3f7-5b62-4484-84a7-c3c493792bde req-55721f51-918a-4540-a89f-a2b6c010a7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f3f032-9a74-4361-a6e5-8d7a2c09aa1f", "name": "network-vif-plugged", "status": "completed", "tag": "2b562495-8684-4c93-b042-c057cbef9900"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:09.759027 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-256c661d-f47c-491a-8a1f-87a9bcbbe3c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:09.764426 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-75b1f3f7-5b62-4484-84a7-c3c493792bde req-55721f51-918a-4540-a89f-a2b6c010a7fc service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:09.765226 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-256c661d-f47c-491a-8a1f-87a9bcbbe3c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:09.765955 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-256c661d-f47c-491a-8a1f-87a9bcbbe3c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:09.766659 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-75b1f3f7-5b62-4484-84a7-c3c493792bde req-55721f51-918a-4540-a89f-a2b6c010a7fc service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:09.767609 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-256c661d-f47c-491a-8a1f-87a9bcbbe3c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:09.768260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-75b1f3f7-5b62-4484-84a7-c3c493792bde req-55721f51-918a-4540-a89f-a2b6c010a7fc service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:09.768916 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-256c661d-f47c-491a-8a1f-87a9bcbbe3c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:09.772425 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-256c661d-f47c-491a-8a1f-87a9bcbbe3c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:09.790940 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-75b1f3f7-5b62-4484-84a7-c3c493792bde req-55721f51-918a-4540-a89f-a2b6c010a7fc service nova] Creating event network-vif-plugged:2b562495-8684-4c93-b042-c057cbef9900 for instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f on hv-cinder-86236 Oct 28 19:07:09.796453 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-75b1f3f7-5b62-4484-84a7-c3c493792bde req-55721f51-918a-4540-a89f-a2b6c010a7fc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058773 Oct 28 19:07:09.798202 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 88/164] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:07:09.909861 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-256c661d-f47c-491a-8a1f-87a9bcbbe3c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:09.918411 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-256c661d-f47c-491a-8a1f-87a9bcbbe3c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.190791 Oct 28 19:07:09.919313 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 77/165] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:09 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:10.211205 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-d0655f3c-1570-448e-9b17-7d19d4979dce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:10.213033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-d0655f3c-1570-448e-9b17-7d19d4979dce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:10.231891 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d0655f3c-1570-448e-9b17-7d19d4979dce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:10.232720 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d0655f3c-1570-448e-9b17-7d19d4979dce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:10.233365 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d0655f3c-1570-448e-9b17-7d19d4979dce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:10.234263 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d0655f3c-1570-448e-9b17-7d19d4979dce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:10.235553 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d0655f3c-1570-448e-9b17-7d19d4979dce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:10.236203 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d0655f3c-1570-448e-9b17-7d19d4979dce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:10.441363 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-d0655f3c-1570-448e-9b17-7d19d4979dce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:10.449050 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-d0655f3c-1570-448e-9b17-7d19d4979dce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.242967 Oct 28 19:07:10.449619 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 89/166] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:10 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:10.943699 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-75263a3b-9968-4a5d-8c9d-2c7c7a3e152f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:10.944300 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-75263a3b-9968-4a5d-8c9d-2c7c7a3e152f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:10.952700 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-75263a3b-9968-4a5d-8c9d-2c7c7a3e152f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:10.953318 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-75263a3b-9968-4a5d-8c9d-2c7c7a3e152f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:10.954521 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-75263a3b-9968-4a5d-8c9d-2c7c7a3e152f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:10.955828 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-75263a3b-9968-4a5d-8c9d-2c7c7a3e152f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:10.956265 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-75263a3b-9968-4a5d-8c9d-2c7c7a3e152f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:10.956812 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-75263a3b-9968-4a5d-8c9d-2c7c7a3e152f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:11.122385 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-75263a3b-9968-4a5d-8c9d-2c7c7a3e152f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:11.132952 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-75263a3b-9968-4a5d-8c9d-2c7c7a3e152f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.194049 Oct 28 19:07:11.133732 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 78/167] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:10 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:11.475916 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-74343fd3-1b4e-4d09-b783-db5f1156ea4c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:11.475916 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-74343fd3-1b4e-4d09-b783-db5f1156ea4c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:11.482113 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-74343fd3-1b4e-4d09-b783-db5f1156ea4c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:11.482718 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-74343fd3-1b4e-4d09-b783-db5f1156ea4c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:11.483305 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-74343fd3-1b4e-4d09-b783-db5f1156ea4c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:11.484255 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-74343fd3-1b4e-4d09-b783-db5f1156ea4c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:11.485354 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-74343fd3-1b4e-4d09-b783-db5f1156ea4c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:11.485793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-74343fd3-1b4e-4d09-b783-db5f1156ea4c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:11.667157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-74343fd3-1b4e-4d09-b783-db5f1156ea4c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:11.677567 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-74343fd3-1b4e-4d09-b783-db5f1156ea4c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1363 microversion: 2.1 time: 0.208299 Oct 28 19:07:11.678147 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 90/168] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:11 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:07:12.158183 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c42f5fbb-88d7-4d51-adc3-f76ef76236b3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:12.159422 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-c42f5fbb-88d7-4d51-adc3-f76ef76236b3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:12.175457 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c42f5fbb-88d7-4d51-adc3-f76ef76236b3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:12.176679 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c42f5fbb-88d7-4d51-adc3-f76ef76236b3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:12.178534 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c42f5fbb-88d7-4d51-adc3-f76ef76236b3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:12.179507 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c42f5fbb-88d7-4d51-adc3-f76ef76236b3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:12.181459 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c42f5fbb-88d7-4d51-adc3-f76ef76236b3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:12.182055 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c42f5fbb-88d7-4d51-adc3-f76ef76236b3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:12.363542 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c42f5fbb-88d7-4d51-adc3-f76ef76236b3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:12.371982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-c42f5fbb-88d7-4d51-adc3-f76ef76236b3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.218496 Oct 28 19:07:12.372556 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 79/169] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:12 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:12.701374 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-79c00525-b5b0-4e09-9743-22e492404509 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:12.702101 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-79c00525-b5b0-4e09-9743-22e492404509 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:12.708609 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-79c00525-b5b0-4e09-9743-22e492404509 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:12.709093 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-79c00525-b5b0-4e09-9743-22e492404509 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:12.709532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-79c00525-b5b0-4e09-9743-22e492404509 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:12.710232 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-79c00525-b5b0-4e09-9743-22e492404509 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:12.710690 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-79c00525-b5b0-4e09-9743-22e492404509 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:12.711152 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-79c00525-b5b0-4e09-9743-22e492404509 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:12.850374 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-79c00525-b5b0-4e09-9743-22e492404509 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:12.858247 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-79c00525-b5b0-4e09-9743-22e492404509 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1550 microversion: 2.1 time: 0.160784 Oct 28 19:07:12.858811 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 91/170] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:12 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:12.882701 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-3efb488a-33c8-4dea-abe9-88aa40a2afff tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:12.883218 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-3efb488a-33c8-4dea-abe9-88aa40a2afff tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:12.889965 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3efb488a-33c8-4dea-abe9-88aa40a2afff tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:12.890424 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3efb488a-33c8-4dea-abe9-88aa40a2afff tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:12.890894 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3efb488a-33c8-4dea-abe9-88aa40a2afff tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:12.891617 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3efb488a-33c8-4dea-abe9-88aa40a2afff tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:12.892161 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3efb488a-33c8-4dea-abe9-88aa40a2afff tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:12.892754 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3efb488a-33c8-4dea-abe9-88aa40a2afff tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:13.066802 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-3efb488a-33c8-4dea-abe9-88aa40a2afff tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.187579 Oct 28 19:07:13.067998 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 80/171] 10.222.0.58 () {58 vars in 1275 bytes} [Fri Oct 28 19:07:12 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/os-interface => generated 285 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:13.411986 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-0a8f33bd-45ef-42cc-bea7-877584f8d032 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:13.415464 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-0a8f33bd-45ef-42cc-bea7-877584f8d032 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:13.431396 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0a8f33bd-45ef-42cc-bea7-877584f8d032 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:13.432147 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0a8f33bd-45ef-42cc-bea7-877584f8d032 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:13.433351 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0a8f33bd-45ef-42cc-bea7-877584f8d032 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:13.436490 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0a8f33bd-45ef-42cc-bea7-877584f8d032 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:13.438405 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0a8f33bd-45ef-42cc-bea7-877584f8d032 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:13.440396 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0a8f33bd-45ef-42cc-bea7-877584f8d032 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:13.744823 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-0a8f33bd-45ef-42cc-bea7-877584f8d032 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:13.767074 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-0a8f33bd-45ef-42cc-bea7-877584f8d032 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.367149 Oct 28 19:07:13.768365 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 92/172] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:13 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:14.792927 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-eb873d9d-5059-4009-b3ac-62afe2ccdb9a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:14.794355 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-eb873d9d-5059-4009-b3ac-62afe2ccdb9a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:14.804528 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eb873d9d-5059-4009-b3ac-62afe2ccdb9a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:14.805425 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eb873d9d-5059-4009-b3ac-62afe2ccdb9a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:14.805856 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eb873d9d-5059-4009-b3ac-62afe2ccdb9a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:14.808974 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eb873d9d-5059-4009-b3ac-62afe2ccdb9a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:14.809929 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eb873d9d-5059-4009-b3ac-62afe2ccdb9a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:14.811278 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eb873d9d-5059-4009-b3ac-62afe2ccdb9a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:14.913824 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-908df807-2b6e-48e8-acf5-7908686aa0b9 req-a744f4d1-45ce-4be1-adcb-600b3fe447ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f3f032-9a74-4361-a6e5-8d7a2c09aa1f", "tag": "2b562495-8684-4c93-b042-c057cbef9900"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:14.939145 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-908df807-2b6e-48e8-acf5-7908686aa0b9 req-a744f4d1-45ce-4be1-adcb-600b3fe447ed service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:14.939628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-908df807-2b6e-48e8-acf5-7908686aa0b9 req-a744f4d1-45ce-4be1-adcb-600b3fe447ed service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:14.940124 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-908df807-2b6e-48e8-acf5-7908686aa0b9 req-a744f4d1-45ce-4be1-adcb-600b3fe447ed service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:14.986533 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-908df807-2b6e-48e8-acf5-7908686aa0b9 req-a744f4d1-45ce-4be1-adcb-600b3fe447ed service nova] Creating event network-changed:2b562495-8684-4c93-b042-c057cbef9900 for instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f on hv-cinder-86236 Oct 28 19:07:15.006360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-908df807-2b6e-48e8-acf5-7908686aa0b9 req-a744f4d1-45ce-4be1-adcb-600b3fe447ed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091314 Oct 28 19:07:15.008158 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 93/173] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:07:15.017477 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-eb873d9d-5059-4009-b3ac-62afe2ccdb9a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:15.033773 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-eb873d9d-5059-4009-b3ac-62afe2ccdb9a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.243338 Oct 28 19:07:15.036040 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 81/174] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:14 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:16.061174 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-d6317cd0-1fc7-4dd1-a4ae-fd66d0012fa5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:16.062015 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-d6317cd0-1fc7-4dd1-a4ae-fd66d0012fa5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:16.075515 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d6317cd0-1fc7-4dd1-a4ae-fd66d0012fa5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:16.076092 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d6317cd0-1fc7-4dd1-a4ae-fd66d0012fa5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:16.076623 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d6317cd0-1fc7-4dd1-a4ae-fd66d0012fa5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:16.079292 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d6317cd0-1fc7-4dd1-a4ae-fd66d0012fa5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:16.081158 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d6317cd0-1fc7-4dd1-a4ae-fd66d0012fa5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:16.081809 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d6317cd0-1fc7-4dd1-a4ae-fd66d0012fa5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:16.750320 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-d6317cd0-1fc7-4dd1-a4ae-fd66d0012fa5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:16.758544 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-d6317cd0-1fc7-4dd1-a4ae-fd66d0012fa5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.702159 Oct 28 19:07:16.759152 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 94/175] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:16 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:17.785515 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-01a08e4d-416b-485b-8ea0-7ed27148173d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:17.786767 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-01a08e4d-416b-485b-8ea0-7ed27148173d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:17.796234 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-01a08e4d-416b-485b-8ea0-7ed27148173d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:17.797127 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-01a08e4d-416b-485b-8ea0-7ed27148173d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:17.800969 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-01a08e4d-416b-485b-8ea0-7ed27148173d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:17.804807 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-01a08e4d-416b-485b-8ea0-7ed27148173d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:17.808298 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-01a08e4d-416b-485b-8ea0-7ed27148173d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:17.809862 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-01a08e4d-416b-485b-8ea0-7ed27148173d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:18.272417 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-01a08e4d-416b-485b-8ea0-7ed27148173d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:18.310531 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-01a08e4d-416b-485b-8ea0-7ed27148173d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.529382 Oct 28 19:07:18.326565 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 82/176] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:17 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:19.341092 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-e62784bc-dcb6-4ef6-a361-bc44265375c6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:19.342698 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-e62784bc-dcb6-4ef6-a361-bc44265375c6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:19.355305 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e62784bc-dcb6-4ef6-a361-bc44265375c6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:19.355949 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e62784bc-dcb6-4ef6-a361-bc44265375c6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:19.356401 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e62784bc-dcb6-4ef6-a361-bc44265375c6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:19.358720 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e62784bc-dcb6-4ef6-a361-bc44265375c6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:19.359825 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e62784bc-dcb6-4ef6-a361-bc44265375c6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:19.362818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e62784bc-dcb6-4ef6-a361-bc44265375c6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:19.772537 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e62784bc-dcb6-4ef6-a361-bc44265375c6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:19.785811 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-e62784bc-dcb6-4ef6-a361-bc44265375c6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.449152 Oct 28 19:07:19.786406 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 95/177] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:19 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:20.163911 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-21531a7d-3754-438f-9e30-b91f41f186b1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:20.164560 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-21531a7d-3754-438f-9e30-b91f41f186b1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:20.181415 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-21531a7d-3754-438f-9e30-b91f41f186b1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:20.182146 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-21531a7d-3754-438f-9e30-b91f41f186b1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:20.182810 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-21531a7d-3754-438f-9e30-b91f41f186b1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:20.183746 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-21531a7d-3754-438f-9e30-b91f41f186b1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:20.184396 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-21531a7d-3754-438f-9e30-b91f41f186b1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:20.185019 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-21531a7d-3754-438f-9e30-b91f41f186b1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:20.239323 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-21531a7d-3754-438f-9e30-b91f41f186b1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Going to try to terminate instance {{(pid=118875) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:07:20.321482 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:20.467805 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-21531a7d-3754-438f-9e30-b91f41f186b1 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 204 len: 0 microversion: 2.1 time: 0.307411 Oct 28 19:07:20.469370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 83/178] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Oct 28 19:07:20 2022] DELETE /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:07:20.480147 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-e453f1e5-742b-4308-ba57-4f346a1c4071 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:20.481575 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-e453f1e5-742b-4308-ba57-4f346a1c4071 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:20.489612 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e453f1e5-742b-4308-ba57-4f346a1c4071 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:20.490352 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e453f1e5-742b-4308-ba57-4f346a1c4071 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:20.490853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e453f1e5-742b-4308-ba57-4f346a1c4071 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:20.491598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e453f1e5-742b-4308-ba57-4f346a1c4071 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:20.492051 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e453f1e5-742b-4308-ba57-4f346a1c4071 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:20.492699 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e453f1e5-742b-4308-ba57-4f346a1c4071 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:20.703341 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e453f1e5-742b-4308-ba57-4f346a1c4071 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:20.715546 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-e453f1e5-742b-4308-ba57-4f346a1c4071 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1553 microversion: 2.1 time: 0.240839 Oct 28 19:07:20.720165 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 96/179] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:20 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1553 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:07:20.813867 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-9b5ecc4b-b6c7-4b29-897a-b12e6ea142c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:20.814606 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-9b5ecc4b-b6c7-4b29-897a-b12e6ea142c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:20.827474 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9b5ecc4b-b6c7-4b29-897a-b12e6ea142c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:20.828536 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9b5ecc4b-b6c7-4b29-897a-b12e6ea142c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:20.836282 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9b5ecc4b-b6c7-4b29-897a-b12e6ea142c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:20.837480 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9b5ecc4b-b6c7-4b29-897a-b12e6ea142c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:20.838119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9b5ecc4b-b6c7-4b29-897a-b12e6ea142c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:20.839286 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9b5ecc4b-b6c7-4b29-897a-b12e6ea142c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:21.085487 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-9b5ecc4b-b6c7-4b29-897a-b12e6ea142c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:21.096776 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-9b5ecc4b-b6c7-4b29-897a-b12e6ea142c8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.289209 Oct 28 19:07:21.107676 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 84/180] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:20 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:21.745579 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-2b0a4b4e-6f84-4ab6-9cac-c2fc3ea123a0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:21.746188 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-2b0a4b4e-6f84-4ab6-9cac-c2fc3ea123a0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:21.755024 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2b0a4b4e-6f84-4ab6-9cac-c2fc3ea123a0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:21.755024 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2b0a4b4e-6f84-4ab6-9cac-c2fc3ea123a0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:21.755378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2b0a4b4e-6f84-4ab6-9cac-c2fc3ea123a0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:21.756074 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2b0a4b4e-6f84-4ab6-9cac-c2fc3ea123a0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:21.758175 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2b0a4b4e-6f84-4ab6-9cac-c2fc3ea123a0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:21.763810 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2b0a4b4e-6f84-4ab6-9cac-c2fc3ea123a0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:21.945324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-2b0a4b4e-6f84-4ab6-9cac-c2fc3ea123a0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:21.955400 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-2b0a4b4e-6f84-4ab6-9cac-c2fc3ea123a0 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1553 microversion: 2.1 time: 0.213591 Oct 28 19:07:21.967474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 97/181] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:21 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1553 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:22.122236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-423594d1-dfdc-4462-8b78-4f1344bab463 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:22.122903 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-423594d1-dfdc-4462-8b78-4f1344bab463 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:22.129185 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-423594d1-dfdc-4462-8b78-4f1344bab463 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:22.129740 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-423594d1-dfdc-4462-8b78-4f1344bab463 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:22.130100 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-423594d1-dfdc-4462-8b78-4f1344bab463 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:22.130786 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-423594d1-dfdc-4462-8b78-4f1344bab463 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:22.131452 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-423594d1-dfdc-4462-8b78-4f1344bab463 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:22.131887 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-423594d1-dfdc-4462-8b78-4f1344bab463 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:22.342501 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-423594d1-dfdc-4462-8b78-4f1344bab463 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:22.350275 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-423594d1-dfdc-4462-8b78-4f1344bab463 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.232441 Oct 28 19:07:22.350857 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 85/182] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:22 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:22.980850 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-9fce674d-c7cf-4a9a-90b9-7351f5e122a8 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:22.982778 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-9fce674d-c7cf-4a9a-90b9-7351f5e122a8 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:23.002306 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9fce674d-c7cf-4a9a-90b9-7351f5e122a8 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:23.003133 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9fce674d-c7cf-4a9a-90b9-7351f5e122a8 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:23.005742 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9fce674d-c7cf-4a9a-90b9-7351f5e122a8 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:23.006758 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9fce674d-c7cf-4a9a-90b9-7351f5e122a8 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:23.009238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9fce674d-c7cf-4a9a-90b9-7351f5e122a8 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:23.009967 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9fce674d-c7cf-4a9a-90b9-7351f5e122a8 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:23.234505 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-9fce674d-c7cf-4a9a-90b9-7351f5e122a8 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:23.245791 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-9fce674d-c7cf-4a9a-90b9-7351f5e122a8 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1553 microversion: 2.1 time: 0.268644 Oct 28 19:07:23.246189 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 98/183] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:22 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1553 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:23.377811 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-a3adf681-d3ce-4b7b-ba49-78fd957cb3d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:23.378302 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-a3adf681-d3ce-4b7b-ba49-78fd957cb3d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:23.393530 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a3adf681-d3ce-4b7b-ba49-78fd957cb3d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:23.394079 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a3adf681-d3ce-4b7b-ba49-78fd957cb3d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:23.394539 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a3adf681-d3ce-4b7b-ba49-78fd957cb3d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:23.397946 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a3adf681-d3ce-4b7b-ba49-78fd957cb3d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:23.399154 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a3adf681-d3ce-4b7b-ba49-78fd957cb3d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:23.399945 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a3adf681-d3ce-4b7b-ba49-78fd957cb3d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:23.830355 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a3adf681-d3ce-4b7b-ba49-78fd957cb3d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:23.844169 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-a3adf681-d3ce-4b7b-ba49-78fd957cb3d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.472403 Oct 28 19:07:23.846585 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 86/184] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:23 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:24.278373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-b4ca6cf7-1d74-4086-ab96-ab2a29a1370e tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:24.279587 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-b4ca6cf7-1d74-4086-ab96-ab2a29a1370e tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:24.291932 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b4ca6cf7-1d74-4086-ab96-ab2a29a1370e tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:24.294103 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b4ca6cf7-1d74-4086-ab96-ab2a29a1370e tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:24.298913 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b4ca6cf7-1d74-4086-ab96-ab2a29a1370e tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:24.300093 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b4ca6cf7-1d74-4086-ab96-ab2a29a1370e tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:24.301723 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b4ca6cf7-1d74-4086-ab96-ab2a29a1370e tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:24.303358 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b4ca6cf7-1d74-4086-ab96-ab2a29a1370e tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:24.679042 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-b4ca6cf7-1d74-4086-ab96-ab2a29a1370e tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:24.694991 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-b4ca6cf7-1d74-4086-ab96-ab2a29a1370e tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1553 microversion: 2.1 time: 0.423204 Oct 28 19:07:24.708452 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 99/185] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:24 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1553 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:24.874658 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-cabf9fce-33b4-4167-a793-1f6ea54d8e8c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:24.878921 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-cabf9fce-33b4-4167-a793-1f6ea54d8e8c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:24.926909 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cabf9fce-33b4-4167-a793-1f6ea54d8e8c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:24.928803 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cabf9fce-33b4-4167-a793-1f6ea54d8e8c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:24.930075 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cabf9fce-33b4-4167-a793-1f6ea54d8e8c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:24.934552 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cabf9fce-33b4-4167-a793-1f6ea54d8e8c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:24.937368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cabf9fce-33b4-4167-a793-1f6ea54d8e8c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:24.938001 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cabf9fce-33b4-4167-a793-1f6ea54d8e8c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:25.116767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-74f5b87c-0935-4463-986b-89373ec76046 req-014d99f8-9617-4e99-b2e7-222d1eb69901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cc0087a-43d0-43ff-b2b7-3b0b50269c3f", "name": "network-vif-deleted", "tag": "7bc5fd69-bbc5-4047-80dc-00c3455bdb88"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:25.143901 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-74f5b87c-0935-4463-986b-89373ec76046 req-014d99f8-9617-4e99-b2e7-222d1eb69901 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:25.144381 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-74f5b87c-0935-4463-986b-89373ec76046 req-014d99f8-9617-4e99-b2e7-222d1eb69901 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:25.145008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-74f5b87c-0935-4463-986b-89373ec76046 req-014d99f8-9617-4e99-b2e7-222d1eb69901 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:25.161099 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-74f5b87c-0935-4463-986b-89373ec76046 req-014d99f8-9617-4e99-b2e7-222d1eb69901 service nova] Creating event network-vif-deleted:7bc5fd69-bbc5-4047-80dc-00c3455bdb88 for instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f on hv-cinder-86236 Oct 28 19:07:25.167396 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-74f5b87c-0935-4463-986b-89373ec76046 req-014d99f8-9617-4e99-b2e7-222d1eb69901 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054212 Oct 28 19:07:25.168220 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 100/186] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:25.392213 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-cabf9fce-33b4-4167-a793-1f6ea54d8e8c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:25.400428 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-cabf9fce-33b4-4167-a793-1f6ea54d8e8c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.530115 Oct 28 19:07:25.416263 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 87/187] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:24 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:25.743589 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-c0ff2ad6-310b-4210-816e-713f35ecb269 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:25.745223 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-c0ff2ad6-310b-4210-816e-713f35ecb269 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:25.758890 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c0ff2ad6-310b-4210-816e-713f35ecb269 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:25.764376 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c0ff2ad6-310b-4210-816e-713f35ecb269 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:25.764830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c0ff2ad6-310b-4210-816e-713f35ecb269 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:25.765947 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c0ff2ad6-310b-4210-816e-713f35ecb269 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:25.766124 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c0ff2ad6-310b-4210-816e-713f35ecb269 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:25.767626 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c0ff2ad6-310b-4210-816e-713f35ecb269 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:26.054761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-c0ff2ad6-310b-4210-816e-713f35ecb269 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095a332a446b4c6a97257bb7c76f1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67626d51a9484e9c98d0a4758707b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:26.064726 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-c0ff2ad6-310b-4210-816e-713f35ecb269 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 200 len: 1345 microversion: 2.1 time: 0.345942 Oct 28 19:07:26.066212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 101/188] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:25 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 1345 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:26.424364 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b387fa37-cf65-401c-9b0c-b1c332e8390d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:26.424981 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b387fa37-cf65-401c-9b0c-b1c332e8390d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:26.440112 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b387fa37-cf65-401c-9b0c-b1c332e8390d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:26.440903 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b387fa37-cf65-401c-9b0c-b1c332e8390d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:26.441299 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b387fa37-cf65-401c-9b0c-b1c332e8390d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:26.443293 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b387fa37-cf65-401c-9b0c-b1c332e8390d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:26.443771 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b387fa37-cf65-401c-9b0c-b1c332e8390d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:26.444207 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b387fa37-cf65-401c-9b0c-b1c332e8390d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:27.091512 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a46123e3-2efc-4c97-9cb5-87ea28ac4f51 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:27.092126 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-a46123e3-2efc-4c97-9cb5-87ea28ac4f51 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:27.106255 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a46123e3-2efc-4c97-9cb5-87ea28ac4f51 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:27.107001 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a46123e3-2efc-4c97-9cb5-87ea28ac4f51 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:27.108716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a46123e3-2efc-4c97-9cb5-87ea28ac4f51 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:27.113872 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a46123e3-2efc-4c97-9cb5-87ea28ac4f51 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:27.114413 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a46123e3-2efc-4c97-9cb5-87ea28ac4f51 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:27.117266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a46123e3-2efc-4c97-9cb5-87ea28ac4f51 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:27.135040 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b387fa37-cf65-401c-9b0c-b1c332e8390d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:27.146843 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-a46123e3-2efc-4c97-9cb5-87ea28ac4f51 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] HTTP exception thrown: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a46123e3-2efc-4c97-9cb5-87ea28ac4f51 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Request method failure captured: Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f HTTP/1.1 Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCgffAeNI871abbOOugGcHWOAsvjowEfVYNaZMU1yjVWWm9PT-G8AeBCVcclt-w5BCKLHA4JDGrsmTTgIw4oTOv__39wxmHCNX-DAOa2MMm-BoNTqabzTFgQwQsN2NZcath8mlK4ccz2JfSm2ybHio-kGIwMeYDm6kXGCBAFzUPPErQ Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: 67626d51a9484e9c98d0a4758707b896 Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-DeleteServersTestJSON-931207525 Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:07:27.151705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:07:27.152967 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/67626d51a9484e9c98d0a4758707b896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/67626d51a9484e9c98d0a4758707b896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/67626d51a9484e9c98d0a4758707b896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_67626d51a9484e9c98d0a4758707b896"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:07:27.152967 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-DeleteServersTestJSON-931207525 Oct 28 19:07:27.152967 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: 67626d51a9484e9c98d0a4758707b896 Oct 28 19:07:27.152967 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-DeleteServersTestJSON-931207525 Oct 28 19:07:27.152967 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-DeleteServersTestJSON-931207525-project Oct 28 19:07:27.152967 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:07:27.152967 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:07:27.152967 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: 095a332a446b4c6a97257bb7c76f1886 Oct 28 19:07:27.152967 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-DeleteServersTestJSON-931207525-project Oct 28 19:07:27.152967 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: > Oct 28 19:07:27.152967 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:27.152967 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'id': '9cc0087a-43d0-43ff-b2b7-3b0b50269c3f'} Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:27.153654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:27.154764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:27.154764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:07:27.154764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:07:27.154764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:07:27.154764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:07:27.154764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:07:27.154764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:07:27.154764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:27.154764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:07:27.154764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:27.154764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:07:27.154764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:27.154764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:27.154764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:27.154764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:27.154764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:27.154764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:27.154764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:07:27.156488 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a46123e3-2efc-4c97-9cb5-87ea28ac4f51 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Returning 404 to user: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:27.156488 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-a46123e3-2efc-4c97-9cb5-87ea28ac4f51 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 404 len: 111 microversion: 2.1 time: 0.067159 Oct 28 19:07:27.161175 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b387fa37-cf65-401c-9b0c-b1c332e8390d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.741240 Oct 28 19:07:27.162297 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 88/189] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:26 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:27.168203 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 102/190] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:27 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:27.309835 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-e9f1e873-1031-44b4-a09a-4188e4fe0a54 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:27.314305 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-e9f1e873-1031-44b4-a09a-4188e4fe0a54 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:27.321617 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:27.324692 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e9f1e873-1031-44b4-a09a-4188e4fe0a54 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:27.333307 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e9f1e873-1031-44b4-a09a-4188e4fe0a54 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:27.334207 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e9f1e873-1031-44b4-a09a-4188e4fe0a54 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:27.335295 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e9f1e873-1031-44b4-a09a-4188e4fe0a54 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:27.336024 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e9f1e873-1031-44b4-a09a-4188e4fe0a54 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:27.336702 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e9f1e873-1031-44b4-a09a-4188e4fe0a54 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:27.517518 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.wsgi [None req-e9f1e873-1031-44b4-a09a-4188e4fe0a54 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] HTTP exception thrown: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-e9f1e873-1031-44b4-a09a-4188e4fe0a54 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Request method failure captured: Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: request: GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f/os-volume_attachments HTTP/1.1 Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept: application/json Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept-Encoding: identity Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Connection: close Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Length: 0 Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Type: application/json Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Host: 10.222.0.58 Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Openstack-System-Scope: None Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Auth-Token: gAAAAABjXCgffAeNI871abbOOugGcHWOAsvjowEfVYNaZMU1yjVWWm9PT-G8AeBCVcclt-w5BCKLHA4JDGrsmTTgIw4oTOv__39wxmHCNX-DAOa2MMm-BoNTqabzTFgQwQsN2NZcath8mlK4ccz2JfSm2ybHio-kGIwMeYDm6kXGCBAFzUPPErQ Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Id: None Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Name: None Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Identity-Status: Confirmed Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Is-Admin-Project: True Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Id: default Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Name: Default Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Id: 67626d51a9484e9c98d0a4758707b896 Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Name: tempest-DeleteServersTestJSON-931207525 Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Role: member,reader Oct 28 19:07:27.521554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Roles: member,reader Oct 28 19:07:27.522944 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/67626d51a9484e9c98d0a4758707b896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/67626d51a9484e9c98d0a4758707b896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/67626d51a9484e9c98d0a4758707b896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_67626d51a9484e9c98d0a4758707b896"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:07:27.522944 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant: tempest-DeleteServersTestJSON-931207525 Oct 28 19:07:27.522944 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Id: 67626d51a9484e9c98d0a4758707b896 Oct 28 19:07:27.522944 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Name: tempest-DeleteServersTestJSON-931207525 Oct 28 19:07:27.522944 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User: tempest-DeleteServersTestJSON-931207525-project Oct 28 19:07:27.522944 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Id: default Oct 28 19:07:27.522944 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Name: Default Oct 28 19:07:27.522944 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Id: 095a332a446b4c6a97257bb7c76f1886 Oct 28 19:07:27.522944 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Name: tempest-DeleteServersTestJSON-931207525-project Oct 28 19:07:27.522944 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: method: > Oct 28 19:07:27.522944 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: exception: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:27.522944 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: action_args: {'server_id': '9cc0087a-43d0-43ff-b2b7-3b0b50269c3f'} Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:27.523982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:27.525267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:07:27.527286 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-e9f1e873-1031-44b4-a09a-4188e4fe0a54 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Returning 404 to user: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. {{(pid=118875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:27.528291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-e9f1e873-1031-44b4-a09a-4188e4fe0a54 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.224258 Oct 28 19:07:27.529562 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 89/191] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Oct 28 19:07:27 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f/os-volume_attachments => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:28.187546 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f06adefb-8a86-475d-9891-6f6857246ec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:28.188232 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f06adefb-8a86-475d-9891-6f6857246ec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:28.201587 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f06adefb-8a86-475d-9891-6f6857246ec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:28.204064 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f06adefb-8a86-475d-9891-6f6857246ec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:28.212367 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f06adefb-8a86-475d-9891-6f6857246ec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:28.213124 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f06adefb-8a86-475d-9891-6f6857246ec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:28.213652 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f06adefb-8a86-475d-9891-6f6857246ec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:28.214079 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f06adefb-8a86-475d-9891-6f6857246ec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:28.552556 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f06adefb-8a86-475d-9891-6f6857246ec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:28.574634 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f06adefb-8a86-475d-9891-6f6857246ec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.390882 Oct 28 19:07:28.576111 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 103/192] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:28 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:28.985272 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-07b6030f-d57c-43bf-9a34-38964f0f5936 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:28.985761 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-07b6030f-d57c-43bf-9a34-38964f0f5936 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:28.994054 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-07b6030f-d57c-43bf-9a34-38964f0f5936 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:29.000273 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-07b6030f-d57c-43bf-9a34-38964f0f5936 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:29.001218 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-07b6030f-d57c-43bf-9a34-38964f0f5936 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:29.002156 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-07b6030f-d57c-43bf-9a34-38964f0f5936 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:29.002811 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-07b6030f-d57c-43bf-9a34-38964f0f5936 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:29.003263 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-07b6030f-d57c-43bf-9a34-38964f0f5936 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:29.036367 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.wsgi [None req-07b6030f-d57c-43bf-9a34-38964f0f5936 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] HTTP exception thrown: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-07b6030f-d57c-43bf-9a34-38964f0f5936 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Request method failure captured: Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: request: DELETE /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f HTTP/1.1 Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept: application/json Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept-Encoding: identity Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Connection: close Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Length: 0 Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Type: application/json Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Host: 10.222.0.58 Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Openstack-System-Scope: None Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Auth-Token: gAAAAABjXCgffAeNI871abbOOugGcHWOAsvjowEfVYNaZMU1yjVWWm9PT-G8AeBCVcclt-w5BCKLHA4JDGrsmTTgIw4oTOv__39wxmHCNX-DAOa2MMm-BoNTqabzTFgQwQsN2NZcath8mlK4ccz2JfSm2ybHio-kGIwMeYDm6kXGCBAFzUPPErQ Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Id: None Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Name: None Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Identity-Status: Confirmed Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Is-Admin-Project: True Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Id: default Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Name: Default Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Id: 67626d51a9484e9c98d0a4758707b896 Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Name: tempest-DeleteServersTestJSON-931207525 Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Role: member,reader Oct 28 19:07:29.040370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Roles: member,reader Oct 28 19:07:29.041731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/67626d51a9484e9c98d0a4758707b896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/67626d51a9484e9c98d0a4758707b896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/67626d51a9484e9c98d0a4758707b896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_67626d51a9484e9c98d0a4758707b896"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:07:29.041731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant: tempest-DeleteServersTestJSON-931207525 Oct 28 19:07:29.041731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Id: 67626d51a9484e9c98d0a4758707b896 Oct 28 19:07:29.041731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Name: tempest-DeleteServersTestJSON-931207525 Oct 28 19:07:29.041731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User: tempest-DeleteServersTestJSON-931207525-project Oct 28 19:07:29.041731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Id: default Oct 28 19:07:29.041731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Name: Default Oct 28 19:07:29.041731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Id: 095a332a446b4c6a97257bb7c76f1886 Oct 28 19:07:29.041731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Name: tempest-DeleteServersTestJSON-931207525-project Oct 28 19:07:29.041731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: method: > Oct 28 19:07:29.041731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: exception: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:29.041731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: action_args: {'id': '9cc0087a-43d0-43ff-b2b7-3b0b50269c3f'} Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:29.042441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:29.043492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:07:29.046273 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-07b6030f-d57c-43bf-9a34-38964f0f5936 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Returning 404 to user: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. {{(pid=118875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:29.057953 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-07b6030f-d57c-43bf-9a34-38964f0f5936 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 404 len: 111 microversion: 2.1 time: 0.076873 Oct 28 19:07:29.058812 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 90/193] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Oct 28 19:07:28 2022] DELETE /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:29.068584 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-bd5e913f-d2e0-4839-8fd6-1c10fca5cd85 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:29.069241 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-bd5e913f-d2e0-4839-8fd6-1c10fca5cd85 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] [instance: 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:29.076192 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bd5e913f-d2e0-4839-8fd6-1c10fca5cd85 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:29.076724 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bd5e913f-d2e0-4839-8fd6-1c10fca5cd85 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:29.077169 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bd5e913f-d2e0-4839-8fd6-1c10fca5cd85 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:29.080907 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bd5e913f-d2e0-4839-8fd6-1c10fca5cd85 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:29.081384 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bd5e913f-d2e0-4839-8fd6-1c10fca5cd85 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:29.081805 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bd5e913f-d2e0-4839-8fd6-1c10fca5cd85 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:29.104929 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-bd5e913f-d2e0-4839-8fd6-1c10fca5cd85 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] HTTP exception thrown: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-bd5e913f-d2e0-4839-8fd6-1c10fca5cd85 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Request method failure captured: Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f HTTP/1.1 Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCgffAeNI871abbOOugGcHWOAsvjowEfVYNaZMU1yjVWWm9PT-G8AeBCVcclt-w5BCKLHA4JDGrsmTTgIw4oTOv__39wxmHCNX-DAOa2MMm-BoNTqabzTFgQwQsN2NZcath8mlK4ccz2JfSm2ybHio-kGIwMeYDm6kXGCBAFzUPPErQ Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: 67626d51a9484e9c98d0a4758707b896 Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-DeleteServersTestJSON-931207525 Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:07:29.106869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:07:29.108422 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/67626d51a9484e9c98d0a4758707b896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/67626d51a9484e9c98d0a4758707b896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/67626d51a9484e9c98d0a4758707b896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_67626d51a9484e9c98d0a4758707b896"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:07:29.108422 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-DeleteServersTestJSON-931207525 Oct 28 19:07:29.108422 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: 67626d51a9484e9c98d0a4758707b896 Oct 28 19:07:29.108422 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-DeleteServersTestJSON-931207525 Oct 28 19:07:29.108422 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-DeleteServersTestJSON-931207525-project Oct 28 19:07:29.108422 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:07:29.108422 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:07:29.108422 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: 095a332a446b4c6a97257bb7c76f1886 Oct 28 19:07:29.108422 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-DeleteServersTestJSON-931207525-project Oct 28 19:07:29.108422 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: > Oct 28 19:07:29.108422 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:29.108422 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'id': '9cc0087a-43d0-43ff-b2b7-3b0b50269c3f'} Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:29.109679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:29.110692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:29.110692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:07:29.110692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:07:29.110692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:07:29.110692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:07:29.110692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:07:29.110692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:07:29.110692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:29.110692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:07:29.110692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:29.110692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:07:29.110692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:29.110692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:29.110692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:29.110692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:29.110692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:29.110692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. Oct 28 19:07:29.110692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:07:29.113344 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-bd5e913f-d2e0-4839-8fd6-1c10fca5cd85 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] Returning 404 to user: Instance 9cc0087a-43d0-43ff-b2b7-3b0b50269c3f could not be found. {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:29.127701 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-bd5e913f-d2e0-4839-8fd6-1c10fca5cd85 tempest-DeleteServersTestJSON-931207525 tempest-DeleteServersTestJSON-931207525-project] 10.222.0.58 "GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f" status: 404 len: 111 microversion: 2.1 time: 0.049850 Oct 28 19:07:29.131768 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 104/194] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:29 2022] GET /compute/v2.1/servers/9cc0087a-43d0-43ff-b2b7-3b0b50269c3f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:29.598897 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-39224eeb-ada1-447e-bcff-d4956d29a44f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:29.599914 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-39224eeb-ada1-447e-bcff-d4956d29a44f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:29.614970 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-39224eeb-ada1-447e-bcff-d4956d29a44f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:29.615851 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-39224eeb-ada1-447e-bcff-d4956d29a44f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:29.617196 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-39224eeb-ada1-447e-bcff-d4956d29a44f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:29.620010 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-39224eeb-ada1-447e-bcff-d4956d29a44f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:29.620732 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-39224eeb-ada1-447e-bcff-d4956d29a44f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:29.621712 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-39224eeb-ada1-447e-bcff-d4956d29a44f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:30.171678 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-39224eeb-ada1-447e-bcff-d4956d29a44f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:30.185314 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-39224eeb-ada1-447e-bcff-d4956d29a44f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.590474 Oct 28 19:07:30.201207 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 91/195] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:29 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:31.211035 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-39a08633-f8df-4440-93ab-52bb16c5770e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:31.211767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-39a08633-f8df-4440-93ab-52bb16c5770e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:31.220284 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-39a08633-f8df-4440-93ab-52bb16c5770e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:31.221844 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-39a08633-f8df-4440-93ab-52bb16c5770e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:31.224421 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-39a08633-f8df-4440-93ab-52bb16c5770e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:31.225460 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-39a08633-f8df-4440-93ab-52bb16c5770e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:31.227307 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-39a08633-f8df-4440-93ab-52bb16c5770e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:31.227745 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-39a08633-f8df-4440-93ab-52bb16c5770e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:31.278917 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=100 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:31.885176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-39a08633-f8df-4440-93ab-52bb16c5770e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:31.896991 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-39a08633-f8df-4440-93ab-52bb16c5770e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.689696 Oct 28 19:07:31.911398 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 105/196] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:31 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:32.947274 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b60268ee-947b-4521-88e5-6d9c2ee7b162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:32.947274 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b60268ee-947b-4521-88e5-6d9c2ee7b162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:32.947274 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b60268ee-947b-4521-88e5-6d9c2ee7b162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:32.947274 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b60268ee-947b-4521-88e5-6d9c2ee7b162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:32.955297 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b60268ee-947b-4521-88e5-6d9c2ee7b162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:32.957462 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b60268ee-947b-4521-88e5-6d9c2ee7b162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:32.958779 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b60268ee-947b-4521-88e5-6d9c2ee7b162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:32.964700 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b60268ee-947b-4521-88e5-6d9c2ee7b162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:33.360870 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b60268ee-947b-4521-88e5-6d9c2ee7b162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:33.397034 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b60268ee-947b-4521-88e5-6d9c2ee7b162 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.467407 Oct 28 19:07:33.411088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 92/197] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:32 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:34.440991 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-5c022ac2-3535-4312-a3de-1f683970ad2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:34.442256 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-5c022ac2-3535-4312-a3de-1f683970ad2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:34.453166 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c022ac2-3535-4312-a3de-1f683970ad2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:34.457327 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c022ac2-3535-4312-a3de-1f683970ad2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:34.457845 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c022ac2-3535-4312-a3de-1f683970ad2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:34.458929 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c022ac2-3535-4312-a3de-1f683970ad2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:34.459060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c022ac2-3535-4312-a3de-1f683970ad2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:34.462148 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c022ac2-3535-4312-a3de-1f683970ad2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:34.830747 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-5c022ac2-3535-4312-a3de-1f683970ad2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:34.847260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-5c022ac2-3535-4312-a3de-1f683970ad2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.408862 Oct 28 19:07:34.847260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 106/198] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:34 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:07:34.963498 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-e7e5fff1-b10e-46b7-870f-58ca80957ab3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:34.964320 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-e7e5fff1-b10e-46b7-870f-58ca80957ab3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:34.977000 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e7e5fff1-b10e-46b7-870f-58ca80957ab3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:34.984456 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e7e5fff1-b10e-46b7-870f-58ca80957ab3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:34.985488 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e7e5fff1-b10e-46b7-870f-58ca80957ab3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:34.986399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e7e5fff1-b10e-46b7-870f-58ca80957ab3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:34.986972 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e7e5fff1-b10e-46b7-870f-58ca80957ab3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:34.987840 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e7e5fff1-b10e-46b7-870f-58ca80957ab3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:35.045878 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-e7e5fff1-b10e-46b7-870f-58ca80957ab3 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/ips" status: 200 len: 152 microversion: 2.20 time: 0.088353 Oct 28 19:07:35.051228 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 93/199] 10.222.0.58 () {60 vars in 1289 bytes} [Fri Oct 28 19:07:34 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/ips => generated 152 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:07:35.875399 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-86bc33f0-3e92-4251-99f9-53891dde8657 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:35.876556 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-86bc33f0-3e92-4251-99f9-53891dde8657 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:35.899280 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86bc33f0-3e92-4251-99f9-53891dde8657 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:35.902809 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86bc33f0-3e92-4251-99f9-53891dde8657 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:35.903446 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86bc33f0-3e92-4251-99f9-53891dde8657 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:35.906215 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86bc33f0-3e92-4251-99f9-53891dde8657 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:35.908543 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86bc33f0-3e92-4251-99f9-53891dde8657 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:35.909145 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86bc33f0-3e92-4251-99f9-53891dde8657 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:36.284680 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-86bc33f0-3e92-4251-99f9-53891dde8657 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:36.308257 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-86bc33f0-3e92-4251-99f9-53891dde8657 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.438643 Oct 28 19:07:36.309738 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 107/200] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:35 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:37.336858 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-f422dabf-5bb8-48f4-a93a-1d763dde0c2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:37.338379 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-f422dabf-5bb8-48f4-a93a-1d763dde0c2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:37.346258 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f422dabf-5bb8-48f4-a93a-1d763dde0c2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:37.347099 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f422dabf-5bb8-48f4-a93a-1d763dde0c2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:37.348046 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f422dabf-5bb8-48f4-a93a-1d763dde0c2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:37.350855 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f422dabf-5bb8-48f4-a93a-1d763dde0c2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:37.352246 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f422dabf-5bb8-48f4-a93a-1d763dde0c2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:37.353960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f422dabf-5bb8-48f4-a93a-1d763dde0c2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:37.573211 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-f422dabf-5bb8-48f4-a93a-1d763dde0c2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:37.591016 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-f422dabf-5bb8-48f4-a93a-1d763dde0c2d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.253155 Oct 28 19:07:37.592597 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 94/201] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:37 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:38.643956 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-3924f661-58cd-40d4-8534-d7d726d89436 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:38.644605 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-3924f661-58cd-40d4-8534-d7d726d89436 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:38.671687 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3924f661-58cd-40d4-8534-d7d726d89436 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:38.672214 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3924f661-58cd-40d4-8534-d7d726d89436 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:38.672657 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3924f661-58cd-40d4-8534-d7d726d89436 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:38.673508 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3924f661-58cd-40d4-8534-d7d726d89436 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:38.673963 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3924f661-58cd-40d4-8534-d7d726d89436 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:38.674672 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3924f661-58cd-40d4-8534-d7d726d89436 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:38.855431 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3924f661-58cd-40d4-8534-d7d726d89436 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:38.864350 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-3924f661-58cd-40d4-8534-d7d726d89436 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.248857 Oct 28 19:07:38.865455 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 108/202] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:38 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:39.890910 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-7bc7ee3e-d4c9-406b-ac85-b7765b4267b6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:39.892188 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-7bc7ee3e-d4c9-406b-ac85-b7765b4267b6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:39.900104 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7bc7ee3e-d4c9-406b-ac85-b7765b4267b6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:39.900821 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7bc7ee3e-d4c9-406b-ac85-b7765b4267b6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:39.901444 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7bc7ee3e-d4c9-406b-ac85-b7765b4267b6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:39.902741 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7bc7ee3e-d4c9-406b-ac85-b7765b4267b6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:39.903506 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7bc7ee3e-d4c9-406b-ac85-b7765b4267b6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:39.904670 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7bc7ee3e-d4c9-406b-ac85-b7765b4267b6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:40.150484 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-7bc7ee3e-d4c9-406b-ac85-b7765b4267b6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:40.161392 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-7bc7ee3e-d4c9-406b-ac85-b7765b4267b6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.276691 Oct 28 19:07:40.162541 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 95/203] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:39 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:40.792490 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-ca60755d-da11-4fc9-bfb7-abc49e18e2b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:40.793779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-ca60755d-da11-4fc9-bfb7-abc49e18e2b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:40.798297 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=44 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:40.805662 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ca60755d-da11-4fc9-bfb7-abc49e18e2b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:40.806660 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ca60755d-da11-4fc9-bfb7-abc49e18e2b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:40.807622 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ca60755d-da11-4fc9-bfb7-abc49e18e2b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:40.808309 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ca60755d-da11-4fc9-bfb7-abc49e18e2b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:40.808767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ca60755d-da11-4fc9-bfb7-abc49e18e2b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:40.809219 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ca60755d-da11-4fc9-bfb7-abc49e18e2b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:40.990369 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.objects.instance [None req-ca60755d-da11-4fc9-bfb7-abc49e18e2b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lazy-loading 'flavor' on Instance uuid 777c1a8e-485a-4333-a800-8586cdc8746b {{(pid=118874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:07:41.185547 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b2842a37-8281-4af0-a00d-fd40358546cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:41.195184 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b2842a37-8281-4af0-a00d-fd40358546cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:41.213714 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b2842a37-8281-4af0-a00d-fd40358546cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:41.214215 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b2842a37-8281-4af0-a00d-fd40358546cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:41.214666 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b2842a37-8281-4af0-a00d-fd40358546cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:41.215423 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b2842a37-8281-4af0-a00d-fd40358546cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:41.216028 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b2842a37-8281-4af0-a00d-fd40358546cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:41.216602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b2842a37-8281-4af0-a00d-fd40358546cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:41.264094 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-ca60755d-da11-4fc9-bfb7-abc49e18e2b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "POST /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/action" status: 202 len: 0 microversion: 2.20 time: 0.475791 Oct 28 19:07:41.272607 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 109/204] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Oct 28 19:07:40 2022] POST /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:07:41.284404 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-47e80168-f93f-4a19-b158-39252945eb02 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:41.285894 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-47e80168-f93f-4a19-b158-39252945eb02 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:41.296834 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-47e80168-f93f-4a19-b158-39252945eb02 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:41.297617 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-47e80168-f93f-4a19-b158-39252945eb02 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:41.298467 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-47e80168-f93f-4a19-b158-39252945eb02 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:41.299928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-47e80168-f93f-4a19-b158-39252945eb02 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:41.300603 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-47e80168-f93f-4a19-b158-39252945eb02 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:41.301906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-47e80168-f93f-4a19-b158-39252945eb02 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:41.410221 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b2842a37-8281-4af0-a00d-fd40358546cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:41.421448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b2842a37-8281-4af0-a00d-fd40358546cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.237217 Oct 28 19:07:41.422223 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 96/205] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:41 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:07:41.515088 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-47e80168-f93f-4a19-b158-39252945eb02 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:41.533093 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-47e80168-f93f-4a19-b158-39252945eb02 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:41.535181 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-47e80168-f93f-4a19-b158-39252945eb02 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:41.538964 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-47e80168-f93f-4a19-b158-39252945eb02 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.263366 Oct 28 19:07:41.541911 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 110/206] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:07:41 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:07:42.448883 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-7e8c64b9-4847-447f-b2c9-2cdc7713c38a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:42.450225 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-7e8c64b9-4847-447f-b2c9-2cdc7713c38a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:42.456956 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7e8c64b9-4847-447f-b2c9-2cdc7713c38a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:42.457447 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7e8c64b9-4847-447f-b2c9-2cdc7713c38a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:42.458105 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7e8c64b9-4847-447f-b2c9-2cdc7713c38a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:42.458807 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7e8c64b9-4847-447f-b2c9-2cdc7713c38a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:42.459304 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7e8c64b9-4847-447f-b2c9-2cdc7713c38a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:42.459938 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7e8c64b9-4847-447f-b2c9-2cdc7713c38a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:42.588143 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-174fea92-cb05-49f4-a23a-18446ddaa330 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:42.593363 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-174fea92-cb05-49f4-a23a-18446ddaa330 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:42.604675 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-7e8c64b9-4847-447f-b2c9-2cdc7713c38a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:42.610592 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-174fea92-cb05-49f4-a23a-18446ddaa330 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:42.611295 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-174fea92-cb05-49f4-a23a-18446ddaa330 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:42.611733 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-174fea92-cb05-49f4-a23a-18446ddaa330 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:42.612633 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-174fea92-cb05-49f4-a23a-18446ddaa330 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:42.614099 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-174fea92-cb05-49f4-a23a-18446ddaa330 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:42.614275 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-7e8c64b9-4847-447f-b2c9-2cdc7713c38a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.169216 Oct 28 19:07:42.616929 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-174fea92-cb05-49f4-a23a-18446ddaa330 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:42.631076 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 97/207] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:42 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:42.816319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-174fea92-cb05-49f4-a23a-18446ddaa330 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:42.828151 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-174fea92-cb05-49f4-a23a-18446ddaa330 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:42.829879 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-174fea92-cb05-49f4-a23a-18446ddaa330 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:42.831056 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-174fea92-cb05-49f4-a23a-18446ddaa330 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.249295 Oct 28 19:07:42.831604 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 111/208] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:07:42 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:07:43.646758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-0f57cc86-6a5b-4055-94fa-f9f5fd35067a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:43.658498 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-0f57cc86-6a5b-4055-94fa-f9f5fd35067a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:43.665709 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0f57cc86-6a5b-4055-94fa-f9f5fd35067a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:43.666316 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0f57cc86-6a5b-4055-94fa-f9f5fd35067a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:43.667018 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0f57cc86-6a5b-4055-94fa-f9f5fd35067a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:43.667955 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0f57cc86-6a5b-4055-94fa-f9f5fd35067a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:43.668596 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0f57cc86-6a5b-4055-94fa-f9f5fd35067a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:43.669096 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0f57cc86-6a5b-4055-94fa-f9f5fd35067a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:43.845402 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-0f57cc86-6a5b-4055-94fa-f9f5fd35067a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:43.854867 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-0f57cc86-6a5b-4055-94fa-f9f5fd35067a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.212000 Oct 28 19:07:43.857146 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-ef5685db-8bde-47b9-b6e0-49de5365bca8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:43.858972 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-ef5685db-8bde-47b9-b6e0-49de5365bca8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:43.865218 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ef5685db-8bde-47b9-b6e0-49de5365bca8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:43.865947 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ef5685db-8bde-47b9-b6e0-49de5365bca8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:43.866619 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ef5685db-8bde-47b9-b6e0-49de5365bca8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:43.867574 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ef5685db-8bde-47b9-b6e0-49de5365bca8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:43.868295 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ef5685db-8bde-47b9-b6e0-49de5365bca8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:43.868947 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ef5685db-8bde-47b9-b6e0-49de5365bca8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:43.870036 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 98/209] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:43 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:44.017320 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ef5685db-8bde-47b9-b6e0-49de5365bca8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:44.026107 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ef5685db-8bde-47b9-b6e0-49de5365bca8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:44.027552 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ef5685db-8bde-47b9-b6e0-49de5365bca8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:44.029019 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-ef5685db-8bde-47b9-b6e0-49de5365bca8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.176252 Oct 28 19:07:44.030495 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 112/210] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:07:43 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:07:44.882112 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-39d35719-af78-4991-8072-2320e19b94a5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:44.882736 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-39d35719-af78-4991-8072-2320e19b94a5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:44.892177 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-39d35719-af78-4991-8072-2320e19b94a5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:44.892821 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-39d35719-af78-4991-8072-2320e19b94a5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:44.893355 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-39d35719-af78-4991-8072-2320e19b94a5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:44.894201 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-39d35719-af78-4991-8072-2320e19b94a5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:44.894770 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-39d35719-af78-4991-8072-2320e19b94a5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:44.895371 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-39d35719-af78-4991-8072-2320e19b94a5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:45.044577 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-39d35719-af78-4991-8072-2320e19b94a5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:45.058336 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-39d35719-af78-4991-8072-2320e19b94a5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.180813 Oct 28 19:07:45.059363 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 99/211] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:44 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:45.069096 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-54123cb5-e840-4b22-9922-54bc9c572646 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:45.070798 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-54123cb5-e840-4b22-9922-54bc9c572646 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:45.077215 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-54123cb5-e840-4b22-9922-54bc9c572646 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:45.077962 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-54123cb5-e840-4b22-9922-54bc9c572646 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:45.078665 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-54123cb5-e840-4b22-9922-54bc9c572646 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:45.079695 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-54123cb5-e840-4b22-9922-54bc9c572646 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:45.080342 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-54123cb5-e840-4b22-9922-54bc9c572646 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:45.080900 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-54123cb5-e840-4b22-9922-54bc9c572646 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:45.260917 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-54123cb5-e840-4b22-9922-54bc9c572646 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:45.272319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-54123cb5-e840-4b22-9922-54bc9c572646 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:45.274563 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-54123cb5-e840-4b22-9922-54bc9c572646 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:45.276209 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-54123cb5-e840-4b22-9922-54bc9c572646 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.212404 Oct 28 19:07:45.277682 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 113/212] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:07:45 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:07:45.793954 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-fecab030-597e-46b8-b4c3-8a6a10f7dc8a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Action: 'create', calling method: .version_select at 0x7f9bf6b02820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-221307694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxUbUfQib+1NRTfOkiz2gebXZQ88zHHDOM4TP3Jx8H/goXro8voyIxHNsla8Y8C0zJshMTwv2O97wsCNuWtPCVgq66zsTwuzD55ZNkrZjzYrZ7Qbaa4bhULCNRddR8B9w=="}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:45.810847 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-fecab030-597e-46b8-b4c3-8a6a10f7dc8a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Getting quotas for project aa4bbb7ba7f14bd9bcaaa0ea461322a6. Resources: {'key_pairs'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:07:45.815394 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-fecab030-597e-46b8-b4c3-8a6a10f7dc8a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Getting quotas for user fec54d8c1ea24cc8bbbeb6fef1fd2028 and project aa4bbb7ba7f14bd9bcaaa0ea461322a6. Resources: {'key_pairs'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:07:45.838627 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-fecab030-597e-46b8-b4c3-8a6a10f7dc8a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.048662 Oct 28 19:07:45.839291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 100/213] 10.222.0.58 () {60 vars in 1159 bytes} [Fri Oct 28 19:07:45 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:46.027145 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-26487ac1-281a-42fe-8f04-fb64d7cc9ebb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-23430921", "imageRef": "a09cda7b-cc60-449b-b17d-a30720f5a54a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-221307694", "networks": [{"uuid": "9d6f30ee-c6c3-4b1f-be5e-2abd59121c79"}]}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:46.086206 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-aff05dd8-5e1f-4e1f-bf64-3c3bc0c78bd8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:46.087175 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-aff05dd8-5e1f-4e1f-bf64-3c3bc0c78bd8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:46.100882 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-aff05dd8-5e1f-4e1f-bf64-3c3bc0c78bd8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:46.101561 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-aff05dd8-5e1f-4e1f-bf64-3c3bc0c78bd8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:46.102707 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-aff05dd8-5e1f-4e1f-bf64-3c3bc0c78bd8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:46.105292 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-aff05dd8-5e1f-4e1f-bf64-3c3bc0c78bd8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:46.108026 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-aff05dd8-5e1f-4e1f-bf64-3c3bc0c78bd8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:46.108426 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.network.neutron [None req-26487ac1-281a-42fe-8f04-fb64d7cc9ebb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] validate_networks() for [('9d6f30ee-c6c3-4b1f-be5e-2abd59121c79', None, None, None, None, None)] {{(pid=118874) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:07:46.108872 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-aff05dd8-5e1f-4e1f-bf64-3c3bc0c78bd8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:46.403777 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-aff05dd8-5e1f-4e1f-bf64-3c3bc0c78bd8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:46.410666 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:46.413041 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-aff05dd8-5e1f-4e1f-bf64-3c3bc0c78bd8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.332231 Oct 28 19:07:46.413614 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 101/214] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:46 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:07:46.418754 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-95c4a5b0-ec7a-4cd5-b01b-3f770510e88c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:46.419588 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-95c4a5b0-ec7a-4cd5-b01b-3f770510e88c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:46.428544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-95c4a5b0-ec7a-4cd5-b01b-3f770510e88c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:46.429011 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-95c4a5b0-ec7a-4cd5-b01b-3f770510e88c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:46.429440 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-95c4a5b0-ec7a-4cd5-b01b-3f770510e88c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:46.430481 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-95c4a5b0-ec7a-4cd5-b01b-3f770510e88c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:46.430932 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-95c4a5b0-ec7a-4cd5-b01b-3f770510e88c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:46.431414 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-95c4a5b0-ec7a-4cd5-b01b-3f770510e88c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:46.687977 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-95c4a5b0-ec7a-4cd5-b01b-3f770510e88c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:46.696789 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-95c4a5b0-ec7a-4cd5-b01b-3f770510e88c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:46.698534 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-95c4a5b0-ec7a-4cd5-b01b-3f770510e88c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:46.699942 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-95c4a5b0-ec7a-4cd5-b01b-3f770510e88c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.285071 Oct 28 19:07:46.700624 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 102/215] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:07:46 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:07:46.877032 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-26487ac1-281a-42fe-8f04-fb64d7cc9ebb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Flavor limits 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:07:46.877736 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-26487ac1-281a-42fe-8f04-fb64d7cc9ebb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Image limits 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:07:46.878327 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-26487ac1-281a-42fe-8f04-fb64d7cc9ebb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Flavor pref 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:07:46.878966 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-26487ac1-281a-42fe-8f04-fb64d7cc9ebb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Image pref 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:07:46.879629 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-26487ac1-281a-42fe-8f04-fb64d7cc9ebb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:07:46.890626 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-26487ac1-281a-42fe-8f04-fb64d7cc9ebb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:46.891309 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-26487ac1-281a-42fe-8f04-fb64d7cc9ebb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:46.891874 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-26487ac1-281a-42fe-8f04-fb64d7cc9ebb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:46.892705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-26487ac1-281a-42fe-8f04-fb64d7cc9ebb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:46.893184 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-26487ac1-281a-42fe-8f04-fb64d7cc9ebb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:46.893591 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-26487ac1-281a-42fe-8f04-fb64d7cc9ebb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:46.936112 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-26487ac1-281a-42fe-8f04-fb64d7cc9ebb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Getting quotas for project aa4bbb7ba7f14bd9bcaaa0ea461322a6. Resources: {'ram', 'instances', 'cores'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:07:46.941811 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-26487ac1-281a-42fe-8f04-fb64d7cc9ebb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Getting quotas for user fec54d8c1ea24cc8bbbeb6fef1fd2028 and project aa4bbb7ba7f14bd9bcaaa0ea461322a6. Resources: {'ram', 'instances', 'cores'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:07:46.955110 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-26487ac1-281a-42fe-8f04-fb64d7cc9ebb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Going to run 1 instances... {{(pid=118874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:07:46.957554 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-26487ac1-281a-42fe-8f04-fb64d7cc9ebb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a09cda7b-cc60-449b-b17d-a30720f5a54a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:07:47.006406 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-26487ac1-281a-42fe-8f04-fb64d7cc9ebb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.993270 Oct 28 19:07:47.013645 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 114/216] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Oct 28 19:07:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:07:47.021135 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-09b8be81-547b-41d8-bce6-b47f69d239e3 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:47.022009 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-09b8be81-547b-41d8-bce6-b47f69d239e3 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:47.089426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-09b8be81-547b-41d8-bce6-b47f69d239e3 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:47.098846 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-09b8be81-547b-41d8-bce6-b47f69d239e3 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1256 microversion: 2.1 time: 0.084476 Oct 28 19:07:47.099832 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 103/217] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:47 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1256 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:07:47.439881 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-d62dbb93-5599-4311-988d-abcea74563f9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:47.440501 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-d62dbb93-5599-4311-988d-abcea74563f9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:47.458635 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d62dbb93-5599-4311-988d-abcea74563f9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:47.459376 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d62dbb93-5599-4311-988d-abcea74563f9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:47.461569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d62dbb93-5599-4311-988d-abcea74563f9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:47.463635 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d62dbb93-5599-4311-988d-abcea74563f9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:47.465789 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d62dbb93-5599-4311-988d-abcea74563f9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:47.466401 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d62dbb93-5599-4311-988d-abcea74563f9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:47.643023 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-d62dbb93-5599-4311-988d-abcea74563f9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:47.651879 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-d62dbb93-5599-4311-988d-abcea74563f9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.215957 Oct 28 19:07:47.652518 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 115/218] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:47 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:47.727768 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-4c07fe79-2e0c-4dfa-8426-dc7ac5dadeec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:47.729198 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-4c07fe79-2e0c-4dfa-8426-dc7ac5dadeec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:47.737809 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4c07fe79-2e0c-4dfa-8426-dc7ac5dadeec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:47.739346 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4c07fe79-2e0c-4dfa-8426-dc7ac5dadeec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:47.740212 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4c07fe79-2e0c-4dfa-8426-dc7ac5dadeec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:47.741312 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4c07fe79-2e0c-4dfa-8426-dc7ac5dadeec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:47.742119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4c07fe79-2e0c-4dfa-8426-dc7ac5dadeec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:47.742688 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4c07fe79-2e0c-4dfa-8426-dc7ac5dadeec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:48.104841 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-4c07fe79-2e0c-4dfa-8426-dc7ac5dadeec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:48.115213 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-4c07fe79-2e0c-4dfa-8426-dc7ac5dadeec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:48.117321 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-4c07fe79-2e0c-4dfa-8426-dc7ac5dadeec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:48.118490 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-4c07fe79-2e0c-4dfa-8426-dc7ac5dadeec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.395028 Oct 28 19:07:48.119243 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 104/219] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:07:47 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:07:48.121631 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-d0139419-f000-47db-9400-332f482301e4 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:48.122233 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-d0139419-f000-47db-9400-332f482301e4 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:48.129317 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d0139419-f000-47db-9400-332f482301e4 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:48.129951 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d0139419-f000-47db-9400-332f482301e4 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:48.130488 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d0139419-f000-47db-9400-332f482301e4 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:48.131550 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d0139419-f000-47db-9400-332f482301e4 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:48.132788 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d0139419-f000-47db-9400-332f482301e4 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:48.133721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d0139419-f000-47db-9400-332f482301e4 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:48.199799 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-d0139419-f000-47db-9400-332f482301e4 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:48.210868 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-d0139419-f000-47db-9400-332f482301e4 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1260 microversion: 2.1 time: 0.093163 Oct 28 19:07:48.211516 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 116/220] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:48 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1260 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:07:48.674642 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-e17825d9-e8cb-4a37-90e6-abcafa473d80 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:48.675365 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-e17825d9-e8cb-4a37-90e6-abcafa473d80 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:48.681773 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e17825d9-e8cb-4a37-90e6-abcafa473d80 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:48.682336 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e17825d9-e8cb-4a37-90e6-abcafa473d80 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:48.682861 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e17825d9-e8cb-4a37-90e6-abcafa473d80 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:48.683800 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e17825d9-e8cb-4a37-90e6-abcafa473d80 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:48.684338 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e17825d9-e8cb-4a37-90e6-abcafa473d80 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:48.684891 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e17825d9-e8cb-4a37-90e6-abcafa473d80 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:48.825674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-e17825d9-e8cb-4a37-90e6-abcafa473d80 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:48.833863 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-e17825d9-e8cb-4a37-90e6-abcafa473d80 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.163184 Oct 28 19:07:48.834434 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 105/221] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:48 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:49.145903 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-bac4d079-70a7-4455-bdba-5d15cef757cc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:49.146540 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-bac4d079-70a7-4455-bdba-5d15cef757cc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:49.152389 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bac4d079-70a7-4455-bdba-5d15cef757cc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:49.153045 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bac4d079-70a7-4455-bdba-5d15cef757cc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:49.153474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bac4d079-70a7-4455-bdba-5d15cef757cc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:49.155297 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bac4d079-70a7-4455-bdba-5d15cef757cc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:49.155752 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bac4d079-70a7-4455-bdba-5d15cef757cc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:49.156174 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bac4d079-70a7-4455-bdba-5d15cef757cc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:49.234106 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-5e67cdfe-3231-442e-ae3f-2ce3b383eddf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:49.235214 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-5e67cdfe-3231-442e-ae3f-2ce3b383eddf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:49.242560 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5e67cdfe-3231-442e-ae3f-2ce3b383eddf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:49.243312 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5e67cdfe-3231-442e-ae3f-2ce3b383eddf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:49.243968 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5e67cdfe-3231-442e-ae3f-2ce3b383eddf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:49.244855 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5e67cdfe-3231-442e-ae3f-2ce3b383eddf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:49.245305 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5e67cdfe-3231-442e-ae3f-2ce3b383eddf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:49.245932 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5e67cdfe-3231-442e-ae3f-2ce3b383eddf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:49.297777 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-bac4d079-70a7-4455-bdba-5d15cef757cc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:49.306595 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-bac4d079-70a7-4455-bdba-5d15cef757cc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:49.308112 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-bac4d079-70a7-4455-bdba-5d15cef757cc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:49.309287 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-bac4d079-70a7-4455-bdba-5d15cef757cc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.167297 Oct 28 19:07:49.310047 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 117/222] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:07:49 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:07:49.318084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-5e67cdfe-3231-442e-ae3f-2ce3b383eddf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:49.325558 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-5e67cdfe-3231-442e-ae3f-2ce3b383eddf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1308 microversion: 2.1 time: 0.095688 Oct 28 19:07:49.331034 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 106/223] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:49 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:49.857295 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-8ea6bc36-df43-4c08-8d44-41c2cda68819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:49.857939 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-8ea6bc36-df43-4c08-8d44-41c2cda68819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:49.865036 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8ea6bc36-df43-4c08-8d44-41c2cda68819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:49.865665 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8ea6bc36-df43-4c08-8d44-41c2cda68819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:49.866108 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8ea6bc36-df43-4c08-8d44-41c2cda68819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:49.866889 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8ea6bc36-df43-4c08-8d44-41c2cda68819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:49.867637 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8ea6bc36-df43-4c08-8d44-41c2cda68819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:49.867855 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8ea6bc36-df43-4c08-8d44-41c2cda68819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:49.999187 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-8ea6bc36-df43-4c08-8d44-41c2cda68819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:50.013124 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-8ea6bc36-df43-4c08-8d44-41c2cda68819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.159513 Oct 28 19:07:50.013704 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 118/224] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:49 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:50.334297 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-7eb2e9fe-6101-482a-b04c-48e513d4d491 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:50.334894 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-7eb2e9fe-6101-482a-b04c-48e513d4d491 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:50.341352 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7eb2e9fe-6101-482a-b04c-48e513d4d491 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:50.341833 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7eb2e9fe-6101-482a-b04c-48e513d4d491 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:50.342272 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7eb2e9fe-6101-482a-b04c-48e513d4d491 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:50.342963 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7eb2e9fe-6101-482a-b04c-48e513d4d491 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:50.343445 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7eb2e9fe-6101-482a-b04c-48e513d4d491 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:50.343868 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7eb2e9fe-6101-482a-b04c-48e513d4d491 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:50.348476 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a1fb3d38-dfaa-4f11-b93a-950957b86a3f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:50.349080 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-a1fb3d38-dfaa-4f11-b93a-950957b86a3f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:50.354781 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a1fb3d38-dfaa-4f11-b93a-950957b86a3f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:50.355298 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a1fb3d38-dfaa-4f11-b93a-950957b86a3f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:50.355775 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a1fb3d38-dfaa-4f11-b93a-950957b86a3f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:50.356398 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a1fb3d38-dfaa-4f11-b93a-950957b86a3f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:50.356847 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a1fb3d38-dfaa-4f11-b93a-950957b86a3f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:50.357266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a1fb3d38-dfaa-4f11-b93a-950957b86a3f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:50.437084 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-a1fb3d38-dfaa-4f11-b93a-950957b86a3f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:50.444693 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-a1fb3d38-dfaa-4f11-b93a-950957b86a3f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1308 microversion: 2.1 time: 0.099947 Oct 28 19:07:50.445266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 119/225] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:50 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:07:50.503165 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-7eb2e9fe-6101-482a-b04c-48e513d4d491 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:50.513862 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-7eb2e9fe-6101-482a-b04c-48e513d4d491 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:50.516272 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-7eb2e9fe-6101-482a-b04c-48e513d4d491 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:50.518021 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-7eb2e9fe-6101-482a-b04c-48e513d4d491 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.187363 Oct 28 19:07:50.518571 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 107/226] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:07:50 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:07:51.036573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-c567003e-d5e5-4c63-8b75-eb577091db5c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:51.037174 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-c567003e-d5e5-4c63-8b75-eb577091db5c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:51.043174 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c567003e-d5e5-4c63-8b75-eb577091db5c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:51.043647 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c567003e-d5e5-4c63-8b75-eb577091db5c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:51.044075 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c567003e-d5e5-4c63-8b75-eb577091db5c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:51.044834 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c567003e-d5e5-4c63-8b75-eb577091db5c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:51.045811 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c567003e-d5e5-4c63-8b75-eb577091db5c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:51.046234 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c567003e-d5e5-4c63-8b75-eb577091db5c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:51.171308 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-c567003e-d5e5-4c63-8b75-eb577091db5c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:51.174742 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:51.179707 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-c567003e-d5e5-4c63-8b75-eb577091db5c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.146981 Oct 28 19:07:51.180263 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 120/227] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:51 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:51.467374 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-6fe11f87-22ec-4149-9113-4cd0d62c7801 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:51.468194 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-6fe11f87-22ec-4149-9113-4cd0d62c7801 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:51.475093 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6fe11f87-22ec-4149-9113-4cd0d62c7801 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:51.475577 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6fe11f87-22ec-4149-9113-4cd0d62c7801 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:51.476019 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6fe11f87-22ec-4149-9113-4cd0d62c7801 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:51.476710 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6fe11f87-22ec-4149-9113-4cd0d62c7801 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:51.477162 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6fe11f87-22ec-4149-9113-4cd0d62c7801 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:51.477589 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6fe11f87-22ec-4149-9113-4cd0d62c7801 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:51.538260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-6fe11f87-22ec-4149-9113-4cd0d62c7801 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:51.543682 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-98d57ec3-6636-47af-bbdd-767e5e82ec0f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:51.544382 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-98d57ec3-6636-47af-bbdd-767e5e82ec0f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:51.547270 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-6fe11f87-22ec-4149-9113-4cd0d62c7801 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1308 microversion: 2.1 time: 0.083973 Oct 28 19:07:51.558388 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 108/228] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:51 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1308 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:51.558837 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-98d57ec3-6636-47af-bbdd-767e5e82ec0f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:51.558837 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-98d57ec3-6636-47af-bbdd-767e5e82ec0f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:51.558837 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-98d57ec3-6636-47af-bbdd-767e5e82ec0f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:51.558837 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-98d57ec3-6636-47af-bbdd-767e5e82ec0f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:51.559201 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-98d57ec3-6636-47af-bbdd-767e5e82ec0f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:51.559201 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-98d57ec3-6636-47af-bbdd-767e5e82ec0f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:51.697586 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-98d57ec3-6636-47af-bbdd-767e5e82ec0f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:51.706147 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-98d57ec3-6636-47af-bbdd-767e5e82ec0f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:51.707646 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-98d57ec3-6636-47af-bbdd-767e5e82ec0f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:51.708802 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-98d57ec3-6636-47af-bbdd-767e5e82ec0f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.169619 Oct 28 19:07:51.709352 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 121/229] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:07:51 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:07:52.202491 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-68ba6e12-7700-4e52-b39a-22fd842fa889 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:52.203136 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-68ba6e12-7700-4e52-b39a-22fd842fa889 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:52.208909 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-68ba6e12-7700-4e52-b39a-22fd842fa889 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:52.209390 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-68ba6e12-7700-4e52-b39a-22fd842fa889 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:52.209831 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-68ba6e12-7700-4e52-b39a-22fd842fa889 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:52.210518 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-68ba6e12-7700-4e52-b39a-22fd842fa889 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:52.210974 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-68ba6e12-7700-4e52-b39a-22fd842fa889 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:52.211425 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-68ba6e12-7700-4e52-b39a-22fd842fa889 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:52.336766 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-68ba6e12-7700-4e52-b39a-22fd842fa889 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:52.345603 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-68ba6e12-7700-4e52-b39a-22fd842fa889 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1522 microversion: 2.1 time: 0.146700 Oct 28 19:07:52.346174 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 109/230] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:52 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:52.570262 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4040a324-90b1-483a-a5d0-e947b07d0785 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:52.570880 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-4040a324-90b1-483a-a5d0-e947b07d0785 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:52.577151 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4040a324-90b1-483a-a5d0-e947b07d0785 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:52.577627 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4040a324-90b1-483a-a5d0-e947b07d0785 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:52.578057 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4040a324-90b1-483a-a5d0-e947b07d0785 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:52.578736 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4040a324-90b1-483a-a5d0-e947b07d0785 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:52.579228 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4040a324-90b1-483a-a5d0-e947b07d0785 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:52.579669 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4040a324-90b1-483a-a5d0-e947b07d0785 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:52.644719 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4040a324-90b1-483a-a5d0-e947b07d0785 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:52.652382 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-4040a324-90b1-483a-a5d0-e947b07d0785 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1308 microversion: 2.1 time: 0.086032 Oct 28 19:07:52.653069 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 122/231] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:52 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1308 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:52.734267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-eafc7edc-5fd5-49b0-b168-60187a3a80d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:52.735460 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-eafc7edc-5fd5-49b0-b168-60187a3a80d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:52.741960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eafc7edc-5fd5-49b0-b168-60187a3a80d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:52.742593 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eafc7edc-5fd5-49b0-b168-60187a3a80d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:52.743074 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eafc7edc-5fd5-49b0-b168-60187a3a80d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:52.743773 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eafc7edc-5fd5-49b0-b168-60187a3a80d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:52.744613 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eafc7edc-5fd5-49b0-b168-60187a3a80d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:52.745232 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eafc7edc-5fd5-49b0-b168-60187a3a80d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:52.879497 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-eafc7edc-5fd5-49b0-b168-60187a3a80d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:52.887852 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-eafc7edc-5fd5-49b0-b168-60187a3a80d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:52.889314 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-eafc7edc-5fd5-49b0-b168-60187a3a80d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:52.890467 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-eafc7edc-5fd5-49b0-b168-60187a3a80d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.160787 Oct 28 19:07:52.891044 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 110/232] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:07:52 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:07:53.368552 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-8eb46270-af03-48b3-867c-8bc124664433 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:53.369154 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-8eb46270-af03-48b3-867c-8bc124664433 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:53.375675 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8eb46270-af03-48b3-867c-8bc124664433 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:53.376149 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8eb46270-af03-48b3-867c-8bc124664433 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:53.376578 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8eb46270-af03-48b3-867c-8bc124664433 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:53.377262 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8eb46270-af03-48b3-867c-8bc124664433 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:53.377708 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8eb46270-af03-48b3-867c-8bc124664433 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:53.378129 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8eb46270-af03-48b3-867c-8bc124664433 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:53.585032 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-8eb46270-af03-48b3-867c-8bc124664433 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:53.593486 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-8eb46270-af03-48b3-867c-8bc124664433 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1502 microversion: 2.1 time: 0.228822 Oct 28 19:07:53.594040 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 123/233] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:53 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1502 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:53.616057 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-12bffba0-8150-4ec5-8d9d-99a2acf6ae9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:53.616656 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-12bffba0-8150-4ec5-8d9d-99a2acf6ae9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:53.622507 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-12bffba0-8150-4ec5-8d9d-99a2acf6ae9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:53.622930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-12bffba0-8150-4ec5-8d9d-99a2acf6ae9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:53.623435 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-12bffba0-8150-4ec5-8d9d-99a2acf6ae9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:53.624120 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-12bffba0-8150-4ec5-8d9d-99a2acf6ae9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:53.624567 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-12bffba0-8150-4ec5-8d9d-99a2acf6ae9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:53.624988 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-12bffba0-8150-4ec5-8d9d-99a2acf6ae9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:53.675658 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-9a055697-a0bf-4f8d-a4f7-20a44c350618 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:53.676339 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-9a055697-a0bf-4f8d-a4f7-20a44c350618 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:53.682820 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9a055697-a0bf-4f8d-a4f7-20a44c350618 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:53.683411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9a055697-a0bf-4f8d-a4f7-20a44c350618 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:53.683935 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9a055697-a0bf-4f8d-a4f7-20a44c350618 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:53.684767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9a055697-a0bf-4f8d-a4f7-20a44c350618 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:53.685292 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9a055697-a0bf-4f8d-a4f7-20a44c350618 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:53.685864 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9a055697-a0bf-4f8d-a4f7-20a44c350618 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:53.807146 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-9a055697-a0bf-4f8d-a4f7-20a44c350618 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:53.817927 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-9a055697-a0bf-4f8d-a4f7-20a44c350618 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1314 microversion: 2.1 time: 0.145870 Oct 28 19:07:53.830777 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 124/234] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:53 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:53.873182 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-12bffba0-8150-4ec5-8d9d-99a2acf6ae9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:53.882535 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-12bffba0-8150-4ec5-8d9d-99a2acf6ae9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1516 microversion: 2.1 time: 0.270271 Oct 28 19:07:53.895804 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 111/235] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:53 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1516 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:53.918945 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-daeedf39-ff5d-46c9-804f-7560e2563e1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:53.921490 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-daeedf39-ff5d-46c9-804f-7560e2563e1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:53.928573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-daeedf39-ff5d-46c9-804f-7560e2563e1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:53.929098 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-daeedf39-ff5d-46c9-804f-7560e2563e1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:53.929747 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-daeedf39-ff5d-46c9-804f-7560e2563e1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:53.930480 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-daeedf39-ff5d-46c9-804f-7560e2563e1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:53.930931 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-daeedf39-ff5d-46c9-804f-7560e2563e1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:53.931391 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-daeedf39-ff5d-46c9-804f-7560e2563e1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:54.166889 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-daeedf39-ff5d-46c9-804f-7560e2563e1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:54.175841 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-daeedf39-ff5d-46c9-804f-7560e2563e1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:54.177305 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-daeedf39-ff5d-46c9-804f-7560e2563e1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:54.178826 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-daeedf39-ff5d-46c9-804f-7560e2563e1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.266273 Oct 28 19:07:54.189485 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 125/236] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:07:53 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:07:54.849123 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-64594a06-8b7e-4371-8bbf-54ed2f79dd0c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:54.849758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-64594a06-8b7e-4371-8bbf-54ed2f79dd0c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:54.861692 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-64594a06-8b7e-4371-8bbf-54ed2f79dd0c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:54.863045 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-64594a06-8b7e-4371-8bbf-54ed2f79dd0c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:54.864132 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-64594a06-8b7e-4371-8bbf-54ed2f79dd0c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:54.865195 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-64594a06-8b7e-4371-8bbf-54ed2f79dd0c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:54.867494 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-64594a06-8b7e-4371-8bbf-54ed2f79dd0c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:54.871660 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-64594a06-8b7e-4371-8bbf-54ed2f79dd0c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:55.218521 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-03fcf762-56d7-48b5-a7f0-83767d1cfdf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:55.219243 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-03fcf762-56d7-48b5-a7f0-83767d1cfdf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:55.237713 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-03fcf762-56d7-48b5-a7f0-83767d1cfdf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:55.240314 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-03fcf762-56d7-48b5-a7f0-83767d1cfdf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:55.241898 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-03fcf762-56d7-48b5-a7f0-83767d1cfdf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:55.242855 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-03fcf762-56d7-48b5-a7f0-83767d1cfdf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:55.246200 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-03fcf762-56d7-48b5-a7f0-83767d1cfdf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:55.246925 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-03fcf762-56d7-48b5-a7f0-83767d1cfdf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:55.343217 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-64594a06-8b7e-4371-8bbf-54ed2f79dd0c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:55.362099 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-64594a06-8b7e-4371-8bbf-54ed2f79dd0c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.522092 Oct 28 19:07:55.379017 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 112/237] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:54 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:55.669593 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-03fcf762-56d7-48b5-a7f0-83767d1cfdf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:55.688388 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-03fcf762-56d7-48b5-a7f0-83767d1cfdf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:55.695304 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-03fcf762-56d7-48b5-a7f0-83767d1cfdf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:55.700043 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-03fcf762-56d7-48b5-a7f0-83767d1cfdf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.484026 Oct 28 19:07:55.700929 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 126/238] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:07:55 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:07:55.997407 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-36759cf2-c259-4fc9-924b-61ae8ba8f988 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:56.001023 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-36759cf2-c259-4fc9-924b-61ae8ba8f988 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:56.009565 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36759cf2-c259-4fc9-924b-61ae8ba8f988 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:56.010300 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36759cf2-c259-4fc9-924b-61ae8ba8f988 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:56.011598 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36759cf2-c259-4fc9-924b-61ae8ba8f988 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:56.012504 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36759cf2-c259-4fc9-924b-61ae8ba8f988 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:56.013199 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36759cf2-c259-4fc9-924b-61ae8ba8f988 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:56.014871 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36759cf2-c259-4fc9-924b-61ae8ba8f988 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:56.057214 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.objects.instance [None req-36759cf2-c259-4fc9-924b-61ae8ba8f988 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lazy-loading 'flavor' on Instance uuid 713b7fcb-dff0-4d52-b071-05b218732625 {{(pid=118875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:07:56.249033 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-36759cf2-c259-4fc9-924b-61ae8ba8f988 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "POST /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625/action" status: 200 len: 32 microversion: 2.1 time: 0.255867 Oct 28 19:07:56.250609 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 113/239] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Oct 28 19:07:55 2022] POST /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625/action => generated 32 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:56.261491 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-0c941491-7f0c-4460-8725-5e970bf0c1c0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:56.262837 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-0c941491-7f0c-4460-8725-5e970bf0c1c0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:56.270672 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0c941491-7f0c-4460-8725-5e970bf0c1c0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:56.271772 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0c941491-7f0c-4460-8725-5e970bf0c1c0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:56.272467 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0c941491-7f0c-4460-8725-5e970bf0c1c0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:56.273923 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0c941491-7f0c-4460-8725-5e970bf0c1c0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:56.274783 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0c941491-7f0c-4460-8725-5e970bf0c1c0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:56.275611 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0c941491-7f0c-4460-8725-5e970bf0c1c0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:56.395074 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-faa634a5-7904-4b67-a0d7-7e40abf0a9aa tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:56.396808 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-faa634a5-7904-4b67-a0d7-7e40abf0a9aa tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:56.412518 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-faa634a5-7904-4b67-a0d7-7e40abf0a9aa tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:56.415021 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-faa634a5-7904-4b67-a0d7-7e40abf0a9aa tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:56.415813 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-faa634a5-7904-4b67-a0d7-7e40abf0a9aa tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:56.417343 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-faa634a5-7904-4b67-a0d7-7e40abf0a9aa tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:56.421756 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-faa634a5-7904-4b67-a0d7-7e40abf0a9aa tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:56.423526 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-faa634a5-7904-4b67-a0d7-7e40abf0a9aa tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:56.568042 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-0c941491-7f0c-4460-8725-5e970bf0c1c0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:56.576358 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-0c941491-7f0c-4460-8725-5e970bf0c1c0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.320234 Oct 28 19:07:56.596935 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 127/240] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:56 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:56.699565 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-ed714232-c040-481c-b47d-4f0ec364b566 req-e4618078-55b2-4739-b1e9-375f210cb376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be43ea5-02f7-43db-8ac7-df770da3592c", "tag": "6c0693d1-2c4b-4d7e-952e-42bbac4297f8"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:56.720609 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-ed714232-c040-481c-b47d-4f0ec364b566 req-e4618078-55b2-4739-b1e9-375f210cb376 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:56.721408 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-ed714232-c040-481c-b47d-4f0ec364b566 req-e4618078-55b2-4739-b1e9-375f210cb376 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:56.722036 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-ed714232-c040-481c-b47d-4f0ec364b566 req-e4618078-55b2-4739-b1e9-375f210cb376 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:56.748636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-ed714232-c040-481c-b47d-4f0ec364b566 req-e4618078-55b2-4739-b1e9-375f210cb376 service nova] Creating event network-changed:6c0693d1-2c4b-4d7e-952e-42bbac4297f8 for instance 6be43ea5-02f7-43db-8ac7-df770da3592c on hv-cinder-86236 Oct 28 19:07:56.764426 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-ed714232-c040-481c-b47d-4f0ec364b566 req-e4618078-55b2-4739-b1e9-375f210cb376 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068532 Oct 28 19:07:56.765710 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 128/241] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:56.771246 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-6492fc4e-a79a-4597-839a-8b97d1639b64 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:56.772099 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-6492fc4e-a79a-4597-839a-8b97d1639b64 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:56.778841 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6492fc4e-a79a-4597-839a-8b97d1639b64 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:56.780006 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6492fc4e-a79a-4597-839a-8b97d1639b64 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:56.780448 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6492fc4e-a79a-4597-839a-8b97d1639b64 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:56.781153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6492fc4e-a79a-4597-839a-8b97d1639b64 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:56.781728 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6492fc4e-a79a-4597-839a-8b97d1639b64 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:56.782158 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6492fc4e-a79a-4597-839a-8b97d1639b64 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:56.901923 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=2 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:56.903747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-faa634a5-7904-4b67-a0d7-7e40abf0a9aa tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:56.915645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-faa634a5-7904-4b67-a0d7-7e40abf0a9aa tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.527454 Oct 28 19:07:56.916270 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 114/242] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:56 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:56.950740 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=6 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:57.081727 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-6492fc4e-a79a-4597-839a-8b97d1639b64 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:57.111417 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-6492fc4e-a79a-4597-839a-8b97d1639b64 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:57.124202 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-6492fc4e-a79a-4597-839a-8b97d1639b64 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:57.125366 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-6492fc4e-a79a-4597-839a-8b97d1639b64 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.357393 Oct 28 19:07:57.125366 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 129/243] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:07:56 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:07:57.609543 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-a32c72e9-2a93-4647-b350-2bc7e39e52e3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:57.611004 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-a32c72e9-2a93-4647-b350-2bc7e39e52e3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:57.620212 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell0:SELECT=6 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:57.621836 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:57.624976 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a32c72e9-2a93-4647-b350-2bc7e39e52e3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:57.626889 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a32c72e9-2a93-4647-b350-2bc7e39e52e3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:57.628250 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a32c72e9-2a93-4647-b350-2bc7e39e52e3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:57.629321 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a32c72e9-2a93-4647-b350-2bc7e39e52e3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:57.630603 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a32c72e9-2a93-4647-b350-2bc7e39e52e3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:57.631433 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a32c72e9-2a93-4647-b350-2bc7e39e52e3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:57.945209 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-c7a2756b-2fab-4366-a175-018b7323f33a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:57.946452 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-c7a2756b-2fab-4366-a175-018b7323f33a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:57.954862 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c7a2756b-2fab-4366-a175-018b7323f33a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:57.957100 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c7a2756b-2fab-4366-a175-018b7323f33a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:57.961466 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c7a2756b-2fab-4366-a175-018b7323f33a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:57.962416 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c7a2756b-2fab-4366-a175-018b7323f33a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:57.963070 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c7a2756b-2fab-4366-a175-018b7323f33a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:57.964278 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c7a2756b-2fab-4366-a175-018b7323f33a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:57.965103 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a32c72e9-2a93-4647-b350-2bc7e39e52e3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:57.979290 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-a32c72e9-2a93-4647-b350-2bc7e39e52e3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.377311 Oct 28 19:07:57.981425 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 115/244] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:57 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:58.151176 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-2199111e-36d6-4f0d-bd35-e66e522f7fee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:58.151910 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-2199111e-36d6-4f0d-bd35-e66e522f7fee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:58.166282 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2199111e-36d6-4f0d-bd35-e66e522f7fee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:58.166841 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2199111e-36d6-4f0d-bd35-e66e522f7fee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:58.167390 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2199111e-36d6-4f0d-bd35-e66e522f7fee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:58.168181 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2199111e-36d6-4f0d-bd35-e66e522f7fee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:58.168613 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2199111e-36d6-4f0d-bd35-e66e522f7fee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:58.169038 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2199111e-36d6-4f0d-bd35-e66e522f7fee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:58.223956 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-c7a2756b-2fab-4366-a175-018b7323f33a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:58.234634 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-c7a2756b-2fab-4366-a175-018b7323f33a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.293391 Oct 28 19:07:58.247648 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 130/245] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:57 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:07:58.381357 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2199111e-36d6-4f0d-bd35-e66e522f7fee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:58.390231 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2199111e-36d6-4f0d-bd35-e66e522f7fee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:58.391944 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2199111e-36d6-4f0d-bd35-e66e522f7fee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:58.393258 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-2199111e-36d6-4f0d-bd35-e66e522f7fee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.247077 Oct 28 19:07:58.407381 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 116/246] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:07:58 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:07:59.014389 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-693a4820-9f65-45fc-b4cc-2a4d3905c5cf tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:59.015169 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-693a4820-9f65-45fc-b4cc-2a4d3905c5cf tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:59.023216 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-693a4820-9f65-45fc-b4cc-2a4d3905c5cf tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:59.024277 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-693a4820-9f65-45fc-b4cc-2a4d3905c5cf tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:59.024724 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-693a4820-9f65-45fc-b4cc-2a4d3905c5cf tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:59.025425 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-693a4820-9f65-45fc-b4cc-2a4d3905c5cf tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:59.025876 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-693a4820-9f65-45fc-b4cc-2a4d3905c5cf tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:59.026302 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-693a4820-9f65-45fc-b4cc-2a4d3905c5cf tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:59.261727 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-2d253e42-76ce-426c-b563-8393022ce8a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:59.263084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-2d253e42-76ce-426c-b563-8393022ce8a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:59.273461 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2d253e42-76ce-426c-b563-8393022ce8a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:59.276276 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2d253e42-76ce-426c-b563-8393022ce8a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:59.276818 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2d253e42-76ce-426c-b563-8393022ce8a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:59.278644 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2d253e42-76ce-426c-b563-8393022ce8a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:59.280112 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2d253e42-76ce-426c-b563-8393022ce8a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:59.280777 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2d253e42-76ce-426c-b563-8393022ce8a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:59.297963 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-693a4820-9f65-45fc-b4cc-2a4d3905c5cf tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:59.308235 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-693a4820-9f65-45fc-b4cc-2a4d3905c5cf tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.300081 Oct 28 19:07:59.326698 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 131/247] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:59 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:59.344034 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:59.418887 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-e3375f55-b29f-4b29-9690-96c35220806d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:59.419528 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-e3375f55-b29f-4b29-9690-96c35220806d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:59.428688 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e3375f55-b29f-4b29-9690-96c35220806d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:59.429476 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e3375f55-b29f-4b29-9690-96c35220806d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:59.430180 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e3375f55-b29f-4b29-9690-96c35220806d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:59.431126 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e3375f55-b29f-4b29-9690-96c35220806d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:59.432210 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e3375f55-b29f-4b29-9690-96c35220806d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:59.432643 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e3375f55-b29f-4b29-9690-96c35220806d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:59.540346 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2d253e42-76ce-426c-b563-8393022ce8a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:59.550399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-2d253e42-76ce-426c-b563-8393022ce8a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.295183 Oct 28 19:07:59.551026 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 117/248] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:59 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:59.650692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e3375f55-b29f-4b29-9690-96c35220806d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:59.664514 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e3375f55-b29f-4b29-9690-96c35220806d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:59.668508 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e3375f55-b29f-4b29-9690-96c35220806d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:59.673499 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-e3375f55-b29f-4b29-9690-96c35220806d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.258312 Oct 28 19:07:59.674261 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 132/249] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:07:59 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:08:00.345951 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d734d9ce-87d6-46b6-80aa-9253e580ed59 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:00.347305 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d734d9ce-87d6-46b6-80aa-9253e580ed59 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:00.357783 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d734d9ce-87d6-46b6-80aa-9253e580ed59 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:00.358592 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d734d9ce-87d6-46b6-80aa-9253e580ed59 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:00.359248 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d734d9ce-87d6-46b6-80aa-9253e580ed59 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:00.360300 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d734d9ce-87d6-46b6-80aa-9253e580ed59 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:00.360757 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d734d9ce-87d6-46b6-80aa-9253e580ed59 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:00.361189 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d734d9ce-87d6-46b6-80aa-9253e580ed59 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:00.510084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d734d9ce-87d6-46b6-80aa-9253e580ed59 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:00.518963 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d734d9ce-87d6-46b6-80aa-9253e580ed59 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.177182 Oct 28 19:08:00.519709 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 118/250] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:00 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:00.573778 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-8218c213-9e9c-438d-90cb-ae82a39ea74e tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:00.574376 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-8218c213-9e9c-438d-90cb-ae82a39ea74e tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:00.581705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8218c213-9e9c-438d-90cb-ae82a39ea74e tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:00.582475 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8218c213-9e9c-438d-90cb-ae82a39ea74e tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:00.582862 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8218c213-9e9c-438d-90cb-ae82a39ea74e tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:00.583659 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8218c213-9e9c-438d-90cb-ae82a39ea74e tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:00.584115 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8218c213-9e9c-438d-90cb-ae82a39ea74e tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:00.584542 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8218c213-9e9c-438d-90cb-ae82a39ea74e tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:00.698586 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-0fe89a0b-9302-4e88-a6c9-2cfe51d1a89d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:00.699521 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-0fe89a0b-9302-4e88-a6c9-2cfe51d1a89d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:00.705721 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0fe89a0b-9302-4e88-a6c9-2cfe51d1a89d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:00.706336 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0fe89a0b-9302-4e88-a6c9-2cfe51d1a89d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:00.707086 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0fe89a0b-9302-4e88-a6c9-2cfe51d1a89d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:00.708012 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0fe89a0b-9302-4e88-a6c9-2cfe51d1a89d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:00.708681 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0fe89a0b-9302-4e88-a6c9-2cfe51d1a89d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:00.709508 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0fe89a0b-9302-4e88-a6c9-2cfe51d1a89d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:00.723942 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-8218c213-9e9c-438d-90cb-ae82a39ea74e tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:00.741978 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-8218c213-9e9c-438d-90cb-ae82a39ea74e tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.172130 Oct 28 19:08:00.742891 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 133/251] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:00 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:00.860313 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-0fe89a0b-9302-4e88-a6c9-2cfe51d1a89d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:00.868643 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-0fe89a0b-9302-4e88-a6c9-2cfe51d1a89d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:00.870103 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-0fe89a0b-9302-4e88-a6c9-2cfe51d1a89d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:00.871280 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-0fe89a0b-9302-4e88-a6c9-2cfe51d1a89d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.177303 Oct 28 19:08:00.871843 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 119/252] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:00 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:01.543090 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-79b930cb-7594-4ddf-880b-2b1ad836e37c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:01.543967 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-79b930cb-7594-4ddf-880b-2b1ad836e37c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:01.552548 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-79b930cb-7594-4ddf-880b-2b1ad836e37c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:01.553350 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-79b930cb-7594-4ddf-880b-2b1ad836e37c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:01.554027 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-79b930cb-7594-4ddf-880b-2b1ad836e37c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:01.554953 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-79b930cb-7594-4ddf-880b-2b1ad836e37c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:01.555630 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-79b930cb-7594-4ddf-880b-2b1ad836e37c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:01.556269 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-79b930cb-7594-4ddf-880b-2b1ad836e37c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:01.722275 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-79b930cb-7594-4ddf-880b-2b1ad836e37c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:01.738062 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-79b930cb-7594-4ddf-880b-2b1ad836e37c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.198889 Oct 28 19:08:01.741922 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 134/253] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:01 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:01.766765 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-1081ff5f-2995-47ac-bd98-ab2848a64225 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:01.768081 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-1081ff5f-2995-47ac-bd98-ab2848a64225 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:01.776777 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1081ff5f-2995-47ac-bd98-ab2848a64225 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:01.777483 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1081ff5f-2995-47ac-bd98-ab2848a64225 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:01.777927 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1081ff5f-2995-47ac-bd98-ab2848a64225 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:01.778633 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1081ff5f-2995-47ac-bd98-ab2848a64225 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:01.779890 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1081ff5f-2995-47ac-bd98-ab2848a64225 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:01.780589 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1081ff5f-2995-47ac-bd98-ab2848a64225 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:01.897280 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-7b0104c7-d0a9-4cf1-84b4-4a2e6883e006 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:01.898226 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-7b0104c7-d0a9-4cf1-84b4-4a2e6883e006 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:01.905082 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7b0104c7-d0a9-4cf1-84b4-4a2e6883e006 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:01.905651 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7b0104c7-d0a9-4cf1-84b4-4a2e6883e006 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:01.906090 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7b0104c7-d0a9-4cf1-84b4-4a2e6883e006 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:01.906788 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7b0104c7-d0a9-4cf1-84b4-4a2e6883e006 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:01.907291 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7b0104c7-d0a9-4cf1-84b4-4a2e6883e006 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:01.907709 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7b0104c7-d0a9-4cf1-84b4-4a2e6883e006 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:01.960980 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1081ff5f-2995-47ac-bd98-ab2848a64225 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:01.972604 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-1081ff5f-2995-47ac-bd98-ab2848a64225 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.211188 Oct 28 19:08:01.986168 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 120/254] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:01 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:02.105796 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-7b0104c7-d0a9-4cf1-84b4-4a2e6883e006 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:02.115128 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-7b0104c7-d0a9-4cf1-84b4-4a2e6883e006 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:02.117040 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-7b0104c7-d0a9-4cf1-84b4-4a2e6883e006 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:02.118822 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-7b0104c7-d0a9-4cf1-84b4-4a2e6883e006 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.225429 Oct 28 19:08:02.123323 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 135/255] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:01 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:08:02.777778 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-356a8f7c-fab2-46ba-b75e-925fbebe11fe tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:02.779078 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-356a8f7c-fab2-46ba-b75e-925fbebe11fe tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:02.786224 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-356a8f7c-fab2-46ba-b75e-925fbebe11fe tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:02.787043 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-356a8f7c-fab2-46ba-b75e-925fbebe11fe tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:02.787658 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-356a8f7c-fab2-46ba-b75e-925fbebe11fe tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:02.788664 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-356a8f7c-fab2-46ba-b75e-925fbebe11fe tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:02.789137 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-356a8f7c-fab2-46ba-b75e-925fbebe11fe tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:02.789735 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-356a8f7c-fab2-46ba-b75e-925fbebe11fe tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:02.950663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-356a8f7c-fab2-46ba-b75e-925fbebe11fe tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:02.959570 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-356a8f7c-fab2-46ba-b75e-925fbebe11fe tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.185523 Oct 28 19:08:02.960159 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 121/256] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:02 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:03.000719 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-dd689d41-6dd2-4826-8802-b6afe3cd7ba8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:03.001390 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-dd689d41-6dd2-4826-8802-b6afe3cd7ba8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:03.007284 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-dd689d41-6dd2-4826-8802-b6afe3cd7ba8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:03.007766 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-dd689d41-6dd2-4826-8802-b6afe3cd7ba8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:03.008203 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-dd689d41-6dd2-4826-8802-b6afe3cd7ba8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:03.008891 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-dd689d41-6dd2-4826-8802-b6afe3cd7ba8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:03.009341 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-dd689d41-6dd2-4826-8802-b6afe3cd7ba8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:03.009764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-dd689d41-6dd2-4826-8802-b6afe3cd7ba8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:03.139967 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-dd689d41-6dd2-4826-8802-b6afe3cd7ba8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:03.144915 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-4fc1b131-935b-4259-9ea5-aa246cc2a1c6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:03.145605 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-4fc1b131-935b-4259-9ea5-aa246cc2a1c6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:03.147930 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-dd689d41-6dd2-4826-8802-b6afe3cd7ba8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.151837 Oct 28 19:08:03.148805 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 136/257] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:02 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:03.151445 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4fc1b131-935b-4259-9ea5-aa246cc2a1c6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:03.151937 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4fc1b131-935b-4259-9ea5-aa246cc2a1c6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:03.152389 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4fc1b131-935b-4259-9ea5-aa246cc2a1c6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:03.153063 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4fc1b131-935b-4259-9ea5-aa246cc2a1c6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:03.153512 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4fc1b131-935b-4259-9ea5-aa246cc2a1c6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:03.153956 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4fc1b131-935b-4259-9ea5-aa246cc2a1c6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:03.305636 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-4fc1b131-935b-4259-9ea5-aa246cc2a1c6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:03.316262 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-4fc1b131-935b-4259-9ea5-aa246cc2a1c6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:03.318841 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-4fc1b131-935b-4259-9ea5-aa246cc2a1c6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:03.320792 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-4fc1b131-935b-4259-9ea5-aa246cc2a1c6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.179590 Oct 28 19:08:03.323166 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 122/258] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:03 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:08:03.990195 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-93489296-e755-44ce-b2e3-88462fbadedb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:03.990195 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-93489296-e755-44ce-b2e3-88462fbadedb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:03.990195 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-93489296-e755-44ce-b2e3-88462fbadedb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:03.990195 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-93489296-e755-44ce-b2e3-88462fbadedb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:03.990684 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-93489296-e755-44ce-b2e3-88462fbadedb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:03.990899 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-93489296-e755-44ce-b2e3-88462fbadedb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:03.991385 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-93489296-e755-44ce-b2e3-88462fbadedb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:03.991899 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-93489296-e755-44ce-b2e3-88462fbadedb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:04.141316 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-93489296-e755-44ce-b2e3-88462fbadedb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:04.149291 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-93489296-e755-44ce-b2e3-88462fbadedb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.171054 Oct 28 19:08:04.149860 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 137/259] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:03 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:04.171404 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-79ff79a9-7125-404b-b390-6045d4414d30 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:04.172126 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-79ff79a9-7125-404b-b390-6045d4414d30 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:04.181593 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-79ff79a9-7125-404b-b390-6045d4414d30 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:04.182096 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-79ff79a9-7125-404b-b390-6045d4414d30 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:04.182536 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-79ff79a9-7125-404b-b390-6045d4414d30 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:04.183277 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-79ff79a9-7125-404b-b390-6045d4414d30 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:04.183740 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-79ff79a9-7125-404b-b390-6045d4414d30 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:04.184176 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-79ff79a9-7125-404b-b390-6045d4414d30 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:04.313955 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-79ff79a9-7125-404b-b390-6045d4414d30 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:04.322326 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-79ff79a9-7125-404b-b390-6045d4414d30 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.155300 Oct 28 19:08:04.322898 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 123/260] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:04 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:04.345867 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f3fd1c9e-d59b-4428-8f22-27f076abdcf5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:04.346474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f3fd1c9e-d59b-4428-8f22-27f076abdcf5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:04.363769 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f3fd1c9e-d59b-4428-8f22-27f076abdcf5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:04.364261 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f3fd1c9e-d59b-4428-8f22-27f076abdcf5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:04.364694 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f3fd1c9e-d59b-4428-8f22-27f076abdcf5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:04.365426 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f3fd1c9e-d59b-4428-8f22-27f076abdcf5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:04.365899 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f3fd1c9e-d59b-4428-8f22-27f076abdcf5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:04.366611 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f3fd1c9e-d59b-4428-8f22-27f076abdcf5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:04.371474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=100 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:04.541870 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f3fd1c9e-d59b-4428-8f22-27f076abdcf5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:04.550703 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f3fd1c9e-d59b-4428-8f22-27f076abdcf5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:04.552282 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f3fd1c9e-d59b-4428-8f22-27f076abdcf5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:04.553447 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f3fd1c9e-d59b-4428-8f22-27f076abdcf5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1744 microversion: 2.20 time: 0.211596 Oct 28 19:08:04.554005 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 138/261] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:04 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1744 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:05.172758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-bfa692e1-1a1e-40db-a52d-b82c9dca68e6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:05.173374 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-bfa692e1-1a1e-40db-a52d-b82c9dca68e6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:05.179627 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bfa692e1-1a1e-40db-a52d-b82c9dca68e6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:05.180104 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bfa692e1-1a1e-40db-a52d-b82c9dca68e6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:05.180539 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bfa692e1-1a1e-40db-a52d-b82c9dca68e6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:05.181225 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bfa692e1-1a1e-40db-a52d-b82c9dca68e6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:05.181673 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bfa692e1-1a1e-40db-a52d-b82c9dca68e6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:05.182094 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bfa692e1-1a1e-40db-a52d-b82c9dca68e6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:05.346416 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-049a2ce8-abe0-4b15-965b-b37748d0aa55 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:05.347834 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-049a2ce8-abe0-4b15-965b-b37748d0aa55 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:05.353881 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-bfa692e1-1a1e-40db-a52d-b82c9dca68e6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:05.355055 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-049a2ce8-abe0-4b15-965b-b37748d0aa55 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:05.355715 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-049a2ce8-abe0-4b15-965b-b37748d0aa55 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:05.356639 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-049a2ce8-abe0-4b15-965b-b37748d0aa55 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:05.358297 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-049a2ce8-abe0-4b15-965b-b37748d0aa55 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:05.358946 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-049a2ce8-abe0-4b15-965b-b37748d0aa55 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:05.359413 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-049a2ce8-abe0-4b15-965b-b37748d0aa55 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:05.373007 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-bfa692e1-1a1e-40db-a52d-b82c9dca68e6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.195302 Oct 28 19:08:05.375742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 124/262] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:05 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:05.522931 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-049a2ce8-abe0-4b15-965b-b37748d0aa55 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:05.530591 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-049a2ce8-abe0-4b15-965b-b37748d0aa55 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.189140 Oct 28 19:08:05.531434 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 139/263] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:05 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:05.579872 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-4862470c-1cbb-4843-a799-f8ae7d006d41 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:05.580604 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-4862470c-1cbb-4843-a799-f8ae7d006d41 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:05.586359 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4862470c-1cbb-4843-a799-f8ae7d006d41 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:05.586834 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4862470c-1cbb-4843-a799-f8ae7d006d41 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:05.587309 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4862470c-1cbb-4843-a799-f8ae7d006d41 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:05.587992 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4862470c-1cbb-4843-a799-f8ae7d006d41 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:05.588438 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4862470c-1cbb-4843-a799-f8ae7d006d41 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:05.588857 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4862470c-1cbb-4843-a799-f8ae7d006d41 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:05.717143 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-4862470c-1cbb-4843-a799-f8ae7d006d41 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:05.725332 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-4862470c-1cbb-4843-a799-f8ae7d006d41 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:05.726815 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-4862470c-1cbb-4843-a799-f8ae7d006d41 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:05.728337 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-4862470c-1cbb-4843-a799-f8ae7d006d41 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1744 microversion: 2.20 time: 0.152711 Oct 28 19:08:05.729472 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 125/264] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:05 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:06.266738 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-771346dc-779e-4f01-86a7-8ecd84bfe65f req-788c0942-2c71-4ff8-b9de-dda84724c63b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "777c1a8e-485a-4333-a800-8586cdc8746b", "name": "network-vif-plugged", "status": "completed", "tag": "63e7b2ed-34d6-4aba-a769-655ad469dbc0"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:06.288152 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-771346dc-779e-4f01-86a7-8ecd84bfe65f req-788c0942-2c71-4ff8-b9de-dda84724c63b service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:06.288637 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-771346dc-779e-4f01-86a7-8ecd84bfe65f req-788c0942-2c71-4ff8-b9de-dda84724c63b service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:06.292675 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-771346dc-779e-4f01-86a7-8ecd84bfe65f req-788c0942-2c71-4ff8-b9de-dda84724c63b service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:06.321929 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-771346dc-779e-4f01-86a7-8ecd84bfe65f req-788c0942-2c71-4ff8-b9de-dda84724c63b service nova] Creating event network-vif-plugged:63e7b2ed-34d6-4aba-a769-655ad469dbc0 for instance 777c1a8e-485a-4333-a800-8586cdc8746b on hv-cinder-86236 Oct 28 19:08:06.328774 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-771346dc-779e-4f01-86a7-8ecd84bfe65f req-788c0942-2c71-4ff8-b9de-dda84724c63b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067857 Oct 28 19:08:06.329618 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 140/265] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:06.398800 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-1f7c9d0c-9484-4afc-a32c-9898c2a0aa82 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:06.399479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-1f7c9d0c-9484-4afc-a32c-9898c2a0aa82 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:06.406459 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1f7c9d0c-9484-4afc-a32c-9898c2a0aa82 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:06.406955 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1f7c9d0c-9484-4afc-a32c-9898c2a0aa82 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:06.407496 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1f7c9d0c-9484-4afc-a32c-9898c2a0aa82 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:06.408207 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1f7c9d0c-9484-4afc-a32c-9898c2a0aa82 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:06.408663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1f7c9d0c-9484-4afc-a32c-9898c2a0aa82 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:06.411258 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1f7c9d0c-9484-4afc-a32c-9898c2a0aa82 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:06.553305 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-7e9984cb-9bbb-4675-9d49-f15a37503f5c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:06.553995 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-7e9984cb-9bbb-4675-9d49-f15a37503f5c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:06.560633 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7e9984cb-9bbb-4675-9d49-f15a37503f5c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:06.561114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7e9984cb-9bbb-4675-9d49-f15a37503f5c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:06.561555 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7e9984cb-9bbb-4675-9d49-f15a37503f5c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:06.562244 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7e9984cb-9bbb-4675-9d49-f15a37503f5c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:06.562693 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7e9984cb-9bbb-4675-9d49-f15a37503f5c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:06.563163 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7e9984cb-9bbb-4675-9d49-f15a37503f5c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:06.662108 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1f7c9d0c-9484-4afc-a32c-9898c2a0aa82 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:06.672109 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-1f7c9d0c-9484-4afc-a32c-9898c2a0aa82 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.277032 Oct 28 19:08:06.672866 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 126/266] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:06 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:06.769128 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-40ceab0f-e736-4cbd-9dca-abe837880de4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:06.769731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-40ceab0f-e736-4cbd-9dca-abe837880de4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:06.775681 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-40ceab0f-e736-4cbd-9dca-abe837880de4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:06.776167 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-40ceab0f-e736-4cbd-9dca-abe837880de4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:06.776603 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-40ceab0f-e736-4cbd-9dca-abe837880de4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:06.777631 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-40ceab0f-e736-4cbd-9dca-abe837880de4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:06.778085 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-40ceab0f-e736-4cbd-9dca-abe837880de4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:06.778510 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-40ceab0f-e736-4cbd-9dca-abe837880de4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:06.813337 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-7e9984cb-9bbb-4675-9d49-f15a37503f5c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:06.822669 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-7e9984cb-9bbb-4675-9d49-f15a37503f5c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.273585 Oct 28 19:08:06.823301 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 141/267] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:06 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:07.027268 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-40ceab0f-e736-4cbd-9dca-abe837880de4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:07.037907 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-40ceab0f-e736-4cbd-9dca-abe837880de4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:07.038928 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-40ceab0f-e736-4cbd-9dca-abe837880de4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:07.040541 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-40ceab0f-e736-4cbd-9dca-abe837880de4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1744 microversion: 2.20 time: 0.276389 Oct 28 19:08:07.041215 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 127/268] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:06 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1744 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:07.695527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-988e0673-d404-4e23-89d8-5dd215a6d517 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:07.696109 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-988e0673-d404-4e23-89d8-5dd215a6d517 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:07.702330 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-988e0673-d404-4e23-89d8-5dd215a6d517 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:07.702814 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-988e0673-d404-4e23-89d8-5dd215a6d517 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:07.703295 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-988e0673-d404-4e23-89d8-5dd215a6d517 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:07.703995 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-988e0673-d404-4e23-89d8-5dd215a6d517 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:07.704450 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-988e0673-d404-4e23-89d8-5dd215a6d517 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:07.704877 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-988e0673-d404-4e23-89d8-5dd215a6d517 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:07.833874 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-988e0673-d404-4e23-89d8-5dd215a6d517 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:07.841965 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-988e0673-d404-4e23-89d8-5dd215a6d517 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.149721 Oct 28 19:08:07.842527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 142/269] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:07 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:07.845911 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-6f7f53b3-fe06-48a1-afc2-3292df513328 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:07.846688 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-6f7f53b3-fe06-48a1-afc2-3292df513328 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:07.853071 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6f7f53b3-fe06-48a1-afc2-3292df513328 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:07.853787 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6f7f53b3-fe06-48a1-afc2-3292df513328 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:07.854299 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6f7f53b3-fe06-48a1-afc2-3292df513328 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:07.855434 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6f7f53b3-fe06-48a1-afc2-3292df513328 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:07.855684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6f7f53b3-fe06-48a1-afc2-3292df513328 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:07.856124 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6f7f53b3-fe06-48a1-afc2-3292df513328 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:07.980915 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-6f7f53b3-fe06-48a1-afc2-3292df513328 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:07.989027 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-6f7f53b3-fe06-48a1-afc2-3292df513328 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.147844 Oct 28 19:08:07.989593 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 128/270] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:07 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:08.066838 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-79902c2e-ac2f-486d-86b2-6d015b8bf4b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:08.067512 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-79902c2e-ac2f-486d-86b2-6d015b8bf4b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:08.073411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-79902c2e-ac2f-486d-86b2-6d015b8bf4b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:08.073895 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-79902c2e-ac2f-486d-86b2-6d015b8bf4b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:08.074333 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-79902c2e-ac2f-486d-86b2-6d015b8bf4b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:08.075039 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-79902c2e-ac2f-486d-86b2-6d015b8bf4b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:08.075512 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-79902c2e-ac2f-486d-86b2-6d015b8bf4b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:08.076569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-79902c2e-ac2f-486d-86b2-6d015b8bf4b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:08.205755 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-79902c2e-ac2f-486d-86b2-6d015b8bf4b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:08.214293 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-79902c2e-ac2f-486d-86b2-6d015b8bf4b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:08.215793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-79902c2e-ac2f-486d-86b2-6d015b8bf4b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:08.217617 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-79902c2e-ac2f-486d-86b2-6d015b8bf4b1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1744 microversion: 2.20 time: 0.154226 Oct 28 19:08:08.218443 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 143/271] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:08 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:08.865430 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-0c04162e-7dfd-44b3-8482-ae945e654d03 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:08.865994 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-0c04162e-7dfd-44b3-8482-ae945e654d03 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:08.872597 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0c04162e-7dfd-44b3-8482-ae945e654d03 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:08.873084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0c04162e-7dfd-44b3-8482-ae945e654d03 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:08.873528 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0c04162e-7dfd-44b3-8482-ae945e654d03 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:08.874222 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0c04162e-7dfd-44b3-8482-ae945e654d03 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:08.874683 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0c04162e-7dfd-44b3-8482-ae945e654d03 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:08.875148 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0c04162e-7dfd-44b3-8482-ae945e654d03 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:09.000230 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-0c04162e-7dfd-44b3-8482-ae945e654d03 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:09.008030 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-0c04162e-7dfd-44b3-8482-ae945e654d03 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.146725 Oct 28 19:08:09.008601 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 129/272] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:08 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:09.011982 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1debe05d-be45-4ffc-be65-d987e11e392a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:09.012619 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-1debe05d-be45-4ffc-be65-d987e11e392a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:09.019203 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1debe05d-be45-4ffc-be65-d987e11e392a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:09.019699 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1debe05d-be45-4ffc-be65-d987e11e392a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:09.020141 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1debe05d-be45-4ffc-be65-d987e11e392a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:09.020836 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1debe05d-be45-4ffc-be65-d987e11e392a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:09.021291 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1debe05d-be45-4ffc-be65-d987e11e392a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:09.021719 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1debe05d-be45-4ffc-be65-d987e11e392a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:09.149793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-1debe05d-be45-4ffc-be65-d987e11e392a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:09.157998 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-1debe05d-be45-4ffc-be65-d987e11e392a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.150331 Oct 28 19:08:09.158563 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 144/273] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:09 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:09.242935 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-e75e042d-a338-4996-ab31-7ebafdc72b9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:09.243564 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-e75e042d-a338-4996-ab31-7ebafdc72b9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:09.250148 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e75e042d-a338-4996-ab31-7ebafdc72b9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:09.250635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e75e042d-a338-4996-ab31-7ebafdc72b9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:09.251174 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e75e042d-a338-4996-ab31-7ebafdc72b9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:09.251799 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e75e042d-a338-4996-ab31-7ebafdc72b9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:09.252250 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e75e042d-a338-4996-ab31-7ebafdc72b9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:09.252675 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e75e042d-a338-4996-ab31-7ebafdc72b9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:09.377203 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-e75e042d-a338-4996-ab31-7ebafdc72b9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:09.385332 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-e75e042d-a338-4996-ab31-7ebafdc72b9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:09.387084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-e75e042d-a338-4996-ab31-7ebafdc72b9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:09.388879 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-e75e042d-a338-4996-ab31-7ebafdc72b9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1744 microversion: 2.20 time: 0.149209 Oct 28 19:08:09.389459 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 130/274] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:09 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:10.032167 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f202a519-2dee-4cd6-a7ce-8b8b5e367566 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:10.032829 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f202a519-2dee-4cd6-a7ce-8b8b5e367566 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:10.039238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f202a519-2dee-4cd6-a7ce-8b8b5e367566 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:10.039725 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f202a519-2dee-4cd6-a7ce-8b8b5e367566 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:10.040167 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f202a519-2dee-4cd6-a7ce-8b8b5e367566 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:10.040907 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f202a519-2dee-4cd6-a7ce-8b8b5e367566 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:10.041316 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f202a519-2dee-4cd6-a7ce-8b8b5e367566 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:10.041746 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f202a519-2dee-4cd6-a7ce-8b8b5e367566 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:10.180630 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-1d494167-136f-466c-bcc1-d41bcaa3688d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:10.181355 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-1d494167-136f-466c-bcc1-d41bcaa3688d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:10.184911 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f202a519-2dee-4cd6-a7ce-8b8b5e367566 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:10.187740 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1d494167-136f-466c-bcc1-d41bcaa3688d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:10.188222 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1d494167-136f-466c-bcc1-d41bcaa3688d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:10.188655 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1d494167-136f-466c-bcc1-d41bcaa3688d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:10.189342 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1d494167-136f-466c-bcc1-d41bcaa3688d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:10.189793 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1d494167-136f-466c-bcc1-d41bcaa3688d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:10.190215 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1d494167-136f-466c-bcc1-d41bcaa3688d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:10.193130 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f202a519-2dee-4cd6-a7ce-8b8b5e367566 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.165524 Oct 28 19:08:10.193776 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 145/275] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:10 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:10.326598 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1d494167-136f-466c-bcc1-d41bcaa3688d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:10.334266 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-1d494167-136f-466c-bcc1-d41bcaa3688d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.157500 Oct 28 19:08:10.334836 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 131/276] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:10 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:10.413755 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-52b55031-11c0-4d4b-b87e-cf528a7d1840 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:10.414362 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-52b55031-11c0-4d4b-b87e-cf528a7d1840 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:10.420324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-52b55031-11c0-4d4b-b87e-cf528a7d1840 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:10.420811 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-52b55031-11c0-4d4b-b87e-cf528a7d1840 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:10.421250 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-52b55031-11c0-4d4b-b87e-cf528a7d1840 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:10.421951 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-52b55031-11c0-4d4b-b87e-cf528a7d1840 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:10.422409 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-52b55031-11c0-4d4b-b87e-cf528a7d1840 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:10.422841 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-52b55031-11c0-4d4b-b87e-cf528a7d1840 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:10.552166 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-52b55031-11c0-4d4b-b87e-cf528a7d1840 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:10.560599 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-52b55031-11c0-4d4b-b87e-cf528a7d1840 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:10.562654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-52b55031-11c0-4d4b-b87e-cf528a7d1840 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:10.563994 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-52b55031-11c0-4d4b-b87e-cf528a7d1840 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1739 microversion: 2.20 time: 0.154080 Oct 28 19:08:10.564724 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 146/277] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:10 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:10.906853 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-a4365c26-b59e-4598-a64a-40938bdba28a tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1939345308", "imageRef": "cd92a575-ed0d-417b-b416-3471be3ba100", "flavorRef": "452", "networks": [{"uuid": "e64b3a9c-06ad-4be0-880a-ebf32d167ac7"}]}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:10.960670 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.network.neutron [None req-a4365c26-b59e-4598-a64a-40938bdba28a tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] validate_networks() for [('e64b3a9c-06ad-4be0-880a-ebf32d167ac7', None, None, None, None, None)] {{(pid=118875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:08:11.216454 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f6e7d066-25f9-42d6-b2be-f1e0769cdb1d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:11.217052 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f6e7d066-25f9-42d6-b2be-f1e0769cdb1d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:11.219335 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:11.224951 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f6e7d066-25f9-42d6-b2be-f1e0769cdb1d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:11.225433 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f6e7d066-25f9-42d6-b2be-f1e0769cdb1d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:11.225867 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f6e7d066-25f9-42d6-b2be-f1e0769cdb1d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:11.226565 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f6e7d066-25f9-42d6-b2be-f1e0769cdb1d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:11.227027 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f6e7d066-25f9-42d6-b2be-f1e0769cdb1d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:11.227482 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f6e7d066-25f9-42d6-b2be-f1e0769cdb1d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:11.388610 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-a4365c26-b59e-4598-a64a-40938bdba28a tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Flavor limits 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:08:11.389100 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-a4365c26-b59e-4598-a64a-40938bdba28a tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Image limits 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:08:11.389555 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-a4365c26-b59e-4598-a64a-40938bdba28a tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Flavor pref 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:08:11.389965 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-a4365c26-b59e-4598-a64a-40938bdba28a tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Image pref 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:08:11.391537 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-a4365c26-b59e-4598-a64a-40938bdba28a tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:08:11.406439 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a4365c26-b59e-4598-a64a-40938bdba28a tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:11.407795 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a4365c26-b59e-4598-a64a-40938bdba28a tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:11.408239 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a4365c26-b59e-4598-a64a-40938bdba28a tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:11.408972 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a4365c26-b59e-4598-a64a-40938bdba28a tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:11.409427 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a4365c26-b59e-4598-a64a-40938bdba28a tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:11.409855 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a4365c26-b59e-4598-a64a-40938bdba28a tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:11.440655 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f6e7d066-25f9-42d6-b2be-f1e0769cdb1d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:11.448622 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f6e7d066-25f9-42d6-b2be-f1e0769cdb1d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.236096 Oct 28 19:08:11.449480 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-a4365c26-b59e-4598-a64a-40938bdba28a tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Getting quotas for project 0121d8f74bf441afb820f567988c4d97. Resources: {'ram', 'instances', 'cores'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:08:11.452989 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 147/278] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:11 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:11.459845 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-5ea45e6a-e3a4-4076-b0c5-5738fe29b151 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:11.460695 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-5ea45e6a-e3a4-4076-b0c5-5738fe29b151 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:11.469108 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-a4365c26-b59e-4598-a64a-40938bdba28a tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Getting quotas for user 8c9a97e40b054a3fad1bd12e80c26708 and project 0121d8f74bf441afb820f567988c4d97. Resources: {'ram', 'instances', 'cores'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:08:11.473854 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5ea45e6a-e3a4-4076-b0c5-5738fe29b151 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:11.474299 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5ea45e6a-e3a4-4076-b0c5-5738fe29b151 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:11.474733 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5ea45e6a-e3a4-4076-b0c5-5738fe29b151 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:11.475459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5ea45e6a-e3a4-4076-b0c5-5738fe29b151 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:11.475902 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5ea45e6a-e3a4-4076-b0c5-5738fe29b151 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:11.478506 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5ea45e6a-e3a4-4076-b0c5-5738fe29b151 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:11.486943 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-a4365c26-b59e-4598-a64a-40938bdba28a tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Going to run 1 instances... {{(pid=118875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:08:11.489287 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-a4365c26-b59e-4598-a64a-40938bdba28a tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd92a575-ed0d-417b-b416-3471be3ba100',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:08:11.571117 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-a4365c26-b59e-4598-a64a-40938bdba28a tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668043 Oct 28 19:08:11.584906 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 132/279] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Oct 28 19:08:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:08:11.595785 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-7ba3a0ec-9907-40b0-a4f6-c61881c15bc4 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:11.596189 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-7ba3a0ec-9907-40b0-a4f6-c61881c15bc4 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:11.691873 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-7ba3a0ec-9907-40b0-a4f6-c61881c15bc4 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:11.722760 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-7ba3a0ec-9907-40b0-a4f6-c61881c15bc4 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1214 microversion: 2.1 time: 0.133576 Oct 28 19:08:11.723483 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 133/280] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:11 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:11.742098 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-aaf2f958-2461-4d73-84d4-6ba508c6b304 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:11.742705 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-aaf2f958-2461-4d73-84d4-6ba508c6b304 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:11.748855 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-5ea45e6a-e3a4-4076-b0c5-5738fe29b151 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:11.759822 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-aaf2f958-2461-4d73-84d4-6ba508c6b304 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:11.761729 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-aaf2f958-2461-4d73-84d4-6ba508c6b304 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:11.762211 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-aaf2f958-2461-4d73-84d4-6ba508c6b304 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:11.762943 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-aaf2f958-2461-4d73-84d4-6ba508c6b304 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:11.763459 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-aaf2f958-2461-4d73-84d4-6ba508c6b304 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:11.763885 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-aaf2f958-2461-4d73-84d4-6ba508c6b304 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:11.764327 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-5ea45e6a-e3a4-4076-b0c5-5738fe29b151 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.309769 Oct 28 19:08:11.765015 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 148/281] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:11 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:12.008568 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-aaf2f958-2461-4d73-84d4-6ba508c6b304 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:12.019087 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-aaf2f958-2461-4d73-84d4-6ba508c6b304 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:12.020545 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-aaf2f958-2461-4d73-84d4-6ba508c6b304 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:12.022225 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-aaf2f958-2461-4d73-84d4-6ba508c6b304 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1739 microversion: 2.20 time: 0.286503 Oct 28 19:08:12.022944 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 134/282] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:11 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1739 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:12.518734 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-01dd25a9-0027-4d61-b9b0-9d52e68cc82f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:12.520136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-01dd25a9-0027-4d61-b9b0-9d52e68cc82f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:12.527478 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-01dd25a9-0027-4d61-b9b0-9d52e68cc82f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:12.528288 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-01dd25a9-0027-4d61-b9b0-9d52e68cc82f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:12.529087 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-01dd25a9-0027-4d61-b9b0-9d52e68cc82f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:12.530567 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-01dd25a9-0027-4d61-b9b0-9d52e68cc82f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:12.531653 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-01dd25a9-0027-4d61-b9b0-9d52e68cc82f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:12.532294 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-01dd25a9-0027-4d61-b9b0-9d52e68cc82f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:12.720525 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-01dd25a9-0027-4d61-b9b0-9d52e68cc82f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:12.728410 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-01dd25a9-0027-4d61-b9b0-9d52e68cc82f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.223208 Oct 28 19:08:12.729032 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 149/283] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:12 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:12.751508 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-fa0b0583-cf38-4d14-8cd0-5dbc30de3883 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:12.752974 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-fa0b0583-cf38-4d14-8cd0-5dbc30de3883 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:12.766554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fa0b0583-cf38-4d14-8cd0-5dbc30de3883 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:12.767109 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fa0b0583-cf38-4d14-8cd0-5dbc30de3883 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:12.767833 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fa0b0583-cf38-4d14-8cd0-5dbc30de3883 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:12.768716 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fa0b0583-cf38-4d14-8cd0-5dbc30de3883 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:12.769234 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fa0b0583-cf38-4d14-8cd0-5dbc30de3883 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:12.769788 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fa0b0583-cf38-4d14-8cd0-5dbc30de3883 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:12.787447 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-3e2c63a6-b9d8-457b-8166-86199b72d8b0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:12.788057 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-3e2c63a6-b9d8-457b-8166-86199b72d8b0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:12.804795 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3e2c63a6-b9d8-457b-8166-86199b72d8b0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:12.805298 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3e2c63a6-b9d8-457b-8166-86199b72d8b0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:12.805740 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3e2c63a6-b9d8-457b-8166-86199b72d8b0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:12.806458 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3e2c63a6-b9d8-457b-8166-86199b72d8b0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:12.810319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3e2c63a6-b9d8-457b-8166-86199b72d8b0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:12.814077 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3e2c63a6-b9d8-457b-8166-86199b72d8b0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:12.863763 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-fa0b0583-cf38-4d14-8cd0-5dbc30de3883 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:12.867664 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=100 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:12.876143 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-fa0b0583-cf38-4d14-8cd0-5dbc30de3883 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1210 microversion: 2.1 time: 0.130028 Oct 28 19:08:12.878217 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 135/284] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:12 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1210 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:13.018916 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3e2c63a6-b9d8-457b-8166-86199b72d8b0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:13.028248 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-3e2c63a6-b9d8-457b-8166-86199b72d8b0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.244266 Oct 28 19:08:13.028808 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 150/285] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:12 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:13.050293 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-bb694f1f-0005-48d8-a4e1-0748084021fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:13.050896 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-bb694f1f-0005-48d8-a4e1-0748084021fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:13.056913 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bb694f1f-0005-48d8-a4e1-0748084021fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:13.062264 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bb694f1f-0005-48d8-a4e1-0748084021fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:13.062802 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bb694f1f-0005-48d8-a4e1-0748084021fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:13.063566 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bb694f1f-0005-48d8-a4e1-0748084021fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:13.064209 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bb694f1f-0005-48d8-a4e1-0748084021fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:13.064795 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bb694f1f-0005-48d8-a4e1-0748084021fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:13.312748 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-bb694f1f-0005-48d8-a4e1-0748084021fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:13.321327 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-bb694f1f-0005-48d8-a4e1-0748084021fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:13.330032 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-bb694f1f-0005-48d8-a4e1-0748084021fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:13.333645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-bb694f1f-0005-48d8-a4e1-0748084021fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1739 microversion: 2.20 time: 0.287380 Oct 28 19:08:13.336343 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 136/286] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:13 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1739 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:13.755497 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-3e9b32f4-249e-4291-9446-e0126be979b1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:13.756107 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-3e9b32f4-249e-4291-9446-e0126be979b1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:13.770866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3e9b32f4-249e-4291-9446-e0126be979b1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:13.772532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3e9b32f4-249e-4291-9446-e0126be979b1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:13.772980 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3e9b32f4-249e-4291-9446-e0126be979b1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:13.773709 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3e9b32f4-249e-4291-9446-e0126be979b1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:13.774165 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3e9b32f4-249e-4291-9446-e0126be979b1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:13.774597 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3e9b32f4-249e-4291-9446-e0126be979b1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:13.905806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c424ae52-95ca-40a4-9772-948be77b659d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:13.906409 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-c424ae52-95ca-40a4-9772-948be77b659d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:13.928797 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c424ae52-95ca-40a4-9772-948be77b659d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:13.929528 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c424ae52-95ca-40a4-9772-948be77b659d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:13.930146 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c424ae52-95ca-40a4-9772-948be77b659d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:13.931060 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c424ae52-95ca-40a4-9772-948be77b659d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:13.931791 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c424ae52-95ca-40a4-9772-948be77b659d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:13.932239 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c424ae52-95ca-40a4-9772-948be77b659d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:14.049276 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c424ae52-95ca-40a4-9772-948be77b659d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:14.058312 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-c424ae52-95ca-40a4-9772-948be77b659d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1266 microversion: 2.1 time: 0.157543 Oct 28 19:08:14.060572 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 137/287] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:13 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:14.077589 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-13b5cfdd-d30d-4a7e-9cc6-8d4ee973ef3d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:14.078543 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-13b5cfdd-d30d-4a7e-9cc6-8d4ee973ef3d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:14.087203 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-13b5cfdd-d30d-4a7e-9cc6-8d4ee973ef3d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:14.087976 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-13b5cfdd-d30d-4a7e-9cc6-8d4ee973ef3d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:14.088599 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-13b5cfdd-d30d-4a7e-9cc6-8d4ee973ef3d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:14.089731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-13b5cfdd-d30d-4a7e-9cc6-8d4ee973ef3d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:14.090351 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-13b5cfdd-d30d-4a7e-9cc6-8d4ee973ef3d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:14.090939 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-13b5cfdd-d30d-4a7e-9cc6-8d4ee973ef3d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:14.097812 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3e9b32f4-249e-4291-9446-e0126be979b1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:14.108978 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-3e9b32f4-249e-4291-9446-e0126be979b1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.358572 Oct 28 19:08:14.110109 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 151/288] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:13 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:14.349467 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-13b5cfdd-d30d-4a7e-9cc6-8d4ee973ef3d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:14.359175 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a547ac39-8c01-4bc9-8526-6b41ae12af39 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:14.359872 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-a547ac39-8c01-4bc9-8526-6b41ae12af39 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:14.362800 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-13b5cfdd-d30d-4a7e-9cc6-8d4ee973ef3d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.300640 Oct 28 19:08:14.365650 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 138/289] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:14 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:14.388393 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a547ac39-8c01-4bc9-8526-6b41ae12af39 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:14.390682 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a547ac39-8c01-4bc9-8526-6b41ae12af39 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:14.391416 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a547ac39-8c01-4bc9-8526-6b41ae12af39 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:14.392861 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a547ac39-8c01-4bc9-8526-6b41ae12af39 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:14.393315 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a547ac39-8c01-4bc9-8526-6b41ae12af39 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:14.395804 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a547ac39-8c01-4bc9-8526-6b41ae12af39 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:14.777332 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-a547ac39-8c01-4bc9-8526-6b41ae12af39 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:14.831428 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-a547ac39-8c01-4bc9-8526-6b41ae12af39 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:14.836947 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-a547ac39-8c01-4bc9-8526-6b41ae12af39 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:14.844320 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-a547ac39-8c01-4bc9-8526-6b41ae12af39 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1739 microversion: 2.20 time: 0.490351 Oct 28 19:08:14.862916 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 152/290] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:14 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1739 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:15.087385 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c56ace16-c4d1-41f0-8a5f-22aabc491daf tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:15.088018 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-c56ace16-c4d1-41f0-8a5f-22aabc491daf tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:15.100974 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c56ace16-c4d1-41f0-8a5f-22aabc491daf tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.101479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c56ace16-c4d1-41f0-8a5f-22aabc491daf tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.101928 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c56ace16-c4d1-41f0-8a5f-22aabc491daf tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.102656 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c56ace16-c4d1-41f0-8a5f-22aabc491daf tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.103145 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c56ace16-c4d1-41f0-8a5f-22aabc491daf tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.103945 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c56ace16-c4d1-41f0-8a5f-22aabc491daf tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.137590 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4284a0ae-a902-4fd5-82c8-cb7618db7417 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:15.138829 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-4284a0ae-a902-4fd5-82c8-cb7618db7417 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:15.150556 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4284a0ae-a902-4fd5-82c8-cb7618db7417 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.151573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4284a0ae-a902-4fd5-82c8-cb7618db7417 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.153308 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4284a0ae-a902-4fd5-82c8-cb7618db7417 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.155528 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4284a0ae-a902-4fd5-82c8-cb7618db7417 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.157848 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4284a0ae-a902-4fd5-82c8-cb7618db7417 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.158942 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4284a0ae-a902-4fd5-82c8-cb7618db7417 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.204782 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c56ace16-c4d1-41f0-8a5f-22aabc491daf tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:15.214598 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-c56ace16-c4d1-41f0-8a5f-22aabc491daf tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1272 microversion: 2.1 time: 0.132503 Oct 28 19:08:15.215452 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 139/291] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:15 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:15.372929 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4284a0ae-a902-4fd5-82c8-cb7618db7417 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:15.380954 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-4284a0ae-a902-4fd5-82c8-cb7618db7417 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.249017 Oct 28 19:08:15.395521 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 153/292] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:15 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:15.395764 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-1fea7aec-2a3a-46f3-bc09-cf95f3a79349 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:15.398075 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-1fea7aec-2a3a-46f3-bc09-cf95f3a79349 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:15.405424 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1fea7aec-2a3a-46f3-bc09-cf95f3a79349 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.406256 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1fea7aec-2a3a-46f3-bc09-cf95f3a79349 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.407001 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1fea7aec-2a3a-46f3-bc09-cf95f3a79349 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.408646 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1fea7aec-2a3a-46f3-bc09-cf95f3a79349 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.409321 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1fea7aec-2a3a-46f3-bc09-cf95f3a79349 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.409956 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1fea7aec-2a3a-46f3-bc09-cf95f3a79349 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.898354 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-200171ef-3988-491b-938b-ac8cb6445cf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:15.899462 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-200171ef-3988-491b-938b-ac8cb6445cf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:15.910865 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-200171ef-3988-491b-938b-ac8cb6445cf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.911429 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-200171ef-3988-491b-938b-ac8cb6445cf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.911870 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-200171ef-3988-491b-938b-ac8cb6445cf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.912580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-200171ef-3988-491b-938b-ac8cb6445cf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.917236 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-200171ef-3988-491b-938b-ac8cb6445cf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.917827 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-200171ef-3988-491b-938b-ac8cb6445cf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.962949 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1fea7aec-2a3a-46f3-bc09-cf95f3a79349 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:15.975323 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-1fea7aec-2a3a-46f3-bc09-cf95f3a79349 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.587529 Oct 28 19:08:15.987066 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 140/293] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:15 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:16.181816 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-200171ef-3988-491b-938b-ac8cb6445cf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:16.220961 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-200171ef-3988-491b-938b-ac8cb6445cf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:16.222434 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-200171ef-3988-491b-938b-ac8cb6445cf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:16.223903 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-200171ef-3988-491b-938b-ac8cb6445cf7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1739 microversion: 2.20 time: 0.330128 Oct 28 19:08:16.236107 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 154/294] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:15 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:08:16.242182 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-30906553-f0d0-4028-ab1a-1a53508b8309 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:16.243108 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-30906553-f0d0-4028-ab1a-1a53508b8309 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:16.250044 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-30906553-f0d0-4028-ab1a-1a53508b8309 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:16.250752 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-30906553-f0d0-4028-ab1a-1a53508b8309 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:16.251573 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-30906553-f0d0-4028-ab1a-1a53508b8309 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:16.252453 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-30906553-f0d0-4028-ab1a-1a53508b8309 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:16.253061 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-30906553-f0d0-4028-ab1a-1a53508b8309 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:16.253924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-30906553-f0d0-4028-ab1a-1a53508b8309 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:16.407109 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-430c3a7f-135a-4cc2-88ff-31d9620085f7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:16.408214 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-430c3a7f-135a-4cc2-88ff-31d9620085f7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:16.422695 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-430c3a7f-135a-4cc2-88ff-31d9620085f7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:16.424090 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-430c3a7f-135a-4cc2-88ff-31d9620085f7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:16.425230 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-430c3a7f-135a-4cc2-88ff-31d9620085f7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:16.425967 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-430c3a7f-135a-4cc2-88ff-31d9620085f7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:16.427741 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-430c3a7f-135a-4cc2-88ff-31d9620085f7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:16.429501 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-430c3a7f-135a-4cc2-88ff-31d9620085f7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:16.502907 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=100 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:16.503851 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-30906553-f0d0-4028-ab1a-1a53508b8309 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:16.520235 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-30906553-f0d0-4028-ab1a-1a53508b8309 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1314 microversion: 2.1 time: 0.285395 Oct 28 19:08:16.521305 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 141/295] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:16 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:16.700946 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-430c3a7f-135a-4cc2-88ff-31d9620085f7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:16.713136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-430c3a7f-135a-4cc2-88ff-31d9620085f7 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.310225 Oct 28 19:08:16.714453 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 155/296] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:16 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:16.874382 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-eb79e2a5-aa31-4cf0-9c8a-dbde58ecdf3e req-b9e3d773-c67b-4df7-a9ae-b74f1e1d3d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be43ea5-02f7-43db-8ac7-df770da3592c", "name": "network-vif-plugged", "status": "completed", "tag": "6c0693d1-2c4b-4d7e-952e-42bbac4297f8"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:16.890558 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-eb79e2a5-aa31-4cf0-9c8a-dbde58ecdf3e req-b9e3d773-c67b-4df7-a9ae-b74f1e1d3d65 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:16.891594 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-eb79e2a5-aa31-4cf0-9c8a-dbde58ecdf3e req-b9e3d773-c67b-4df7-a9ae-b74f1e1d3d65 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:16.892121 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-eb79e2a5-aa31-4cf0-9c8a-dbde58ecdf3e req-b9e3d773-c67b-4df7-a9ae-b74f1e1d3d65 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:16.908492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-eb79e2a5-aa31-4cf0-9c8a-dbde58ecdf3e req-b9e3d773-c67b-4df7-a9ae-b74f1e1d3d65 service nova] Creating event network-vif-plugged:6c0693d1-2c4b-4d7e-952e-42bbac4297f8 for instance 6be43ea5-02f7-43db-8ac7-df770da3592c on hv-cinder-86236 Oct 28 19:08:16.914059 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-eb79e2a5-aa31-4cf0-9c8a-dbde58ecdf3e req-b9e3d773-c67b-4df7-a9ae-b74f1e1d3d65 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044574 Oct 28 19:08:16.915136 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 142/297] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:17.003587 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-3c0dcde4-f247-4874-adab-2454c7818904 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:17.004291 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-3c0dcde4-f247-4874-adab-2454c7818904 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:17.018317 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3c0dcde4-f247-4874-adab-2454c7818904 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:17.019123 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3c0dcde4-f247-4874-adab-2454c7818904 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:17.019786 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3c0dcde4-f247-4874-adab-2454c7818904 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:17.020731 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3c0dcde4-f247-4874-adab-2454c7818904 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:17.021820 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3c0dcde4-f247-4874-adab-2454c7818904 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:17.022459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3c0dcde4-f247-4874-adab-2454c7818904 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:17.218484 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3c0dcde4-f247-4874-adab-2454c7818904 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:17.235069 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-3c0dcde4-f247-4874-adab-2454c7818904 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.232469 Oct 28 19:08:17.238148 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 156/298] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:16 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:17.262471 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-758284a5-c6f0-45ac-8805-9c207c70f115 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:17.263972 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-758284a5-c6f0-45ac-8805-9c207c70f115 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:17.278934 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-758284a5-c6f0-45ac-8805-9c207c70f115 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:17.279469 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-758284a5-c6f0-45ac-8805-9c207c70f115 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:17.283257 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-758284a5-c6f0-45ac-8805-9c207c70f115 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:17.284042 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-758284a5-c6f0-45ac-8805-9c207c70f115 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:17.284510 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-758284a5-c6f0-45ac-8805-9c207c70f115 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:17.284951 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-758284a5-c6f0-45ac-8805-9c207c70f115 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:17.440213 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-03b33e2d-d4ff-4cb0-ba8d-dd48a15887ff req-12ddef3e-f8fb-43ad-a40f-1d4a5072a54d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aebba68c-5119-44db-a52d-79e084c80e38", "tag": "80595f06-16ac-45fe-89be-88081a904fbe"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:17.458134 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-03b33e2d-d4ff-4cb0-ba8d-dd48a15887ff req-12ddef3e-f8fb-43ad-a40f-1d4a5072a54d service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:17.459631 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-03b33e2d-d4ff-4cb0-ba8d-dd48a15887ff req-12ddef3e-f8fb-43ad-a40f-1d4a5072a54d service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:17.460946 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-03b33e2d-d4ff-4cb0-ba8d-dd48a15887ff req-12ddef3e-f8fb-43ad-a40f-1d4a5072a54d service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:17.493425 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-03b33e2d-d4ff-4cb0-ba8d-dd48a15887ff req-12ddef3e-f8fb-43ad-a40f-1d4a5072a54d service nova] Creating event network-changed:80595f06-16ac-45fe-89be-88081a904fbe for instance aebba68c-5119-44db-a52d-79e084c80e38 on hv-cinder-86236 Oct 28 19:08:17.505767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-03b33e2d-d4ff-4cb0-ba8d-dd48a15887ff req-12ddef3e-f8fb-43ad-a40f-1d4a5072a54d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071127 Oct 28 19:08:17.507380 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 157/299] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:08:17.558057 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-69e1f15f-6448-4182-aed3-6170e9dc5d7c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:17.559184 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-69e1f15f-6448-4182-aed3-6170e9dc5d7c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:17.568544 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-69e1f15f-6448-4182-aed3-6170e9dc5d7c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:17.569386 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-69e1f15f-6448-4182-aed3-6170e9dc5d7c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:17.570217 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-69e1f15f-6448-4182-aed3-6170e9dc5d7c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:17.571181 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-69e1f15f-6448-4182-aed3-6170e9dc5d7c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:17.572200 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-69e1f15f-6448-4182-aed3-6170e9dc5d7c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:17.574297 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-69e1f15f-6448-4182-aed3-6170e9dc5d7c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:17.623112 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-758284a5-c6f0-45ac-8805-9c207c70f115 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:17.639482 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-758284a5-c6f0-45ac-8805-9c207c70f115 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:17.645184 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-758284a5-c6f0-45ac-8805-9c207c70f115 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:17.651269 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-758284a5-c6f0-45ac-8805-9c207c70f115 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1739 microversion: 2.20 time: 0.390313 Oct 28 19:08:17.652515 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 143/300] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:17 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1739 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:17.743698 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-da498252-552b-40cc-a1ac-fcb649107bf0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:17.744778 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-da498252-552b-40cc-a1ac-fcb649107bf0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:17.765823 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-da498252-552b-40cc-a1ac-fcb649107bf0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:17.766760 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-da498252-552b-40cc-a1ac-fcb649107bf0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:17.767497 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-da498252-552b-40cc-a1ac-fcb649107bf0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:17.768486 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-da498252-552b-40cc-a1ac-fcb649107bf0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:17.769177 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-da498252-552b-40cc-a1ac-fcb649107bf0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:17.769835 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-da498252-552b-40cc-a1ac-fcb649107bf0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:17.805725 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-69e1f15f-6448-4182-aed3-6170e9dc5d7c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:17.814535 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-69e1f15f-6448-4182-aed3-6170e9dc5d7c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1314 microversion: 2.1 time: 0.272177 Oct 28 19:08:17.815096 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 158/301] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:17 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:17.961253 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-da498252-552b-40cc-a1ac-fcb649107bf0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:17.972637 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-da498252-552b-40cc-a1ac-fcb649107bf0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.234232 Oct 28 19:08:17.976137 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 144/302] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:17 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:18.266324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f19e4591-9eb4-421e-b747-b488db7e342b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:18.268494 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f19e4591-9eb4-421e-b747-b488db7e342b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:18.276430 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f19e4591-9eb4-421e-b747-b488db7e342b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.276544 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f19e4591-9eb4-421e-b747-b488db7e342b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.277048 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f19e4591-9eb4-421e-b747-b488db7e342b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.277691 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f19e4591-9eb4-421e-b747-b488db7e342b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.278225 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f19e4591-9eb4-421e-b747-b488db7e342b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.279569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f19e4591-9eb4-421e-b747-b488db7e342b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.493322 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f19e4591-9eb4-421e-b747-b488db7e342b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:18.501589 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f19e4591-9eb4-421e-b747-b488db7e342b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.242926 Oct 28 19:08:18.502168 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 159/303] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:18 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:18.692109 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-14f13283-1bb2-4c3d-a92e-478327894782 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:18.692726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-14f13283-1bb2-4c3d-a92e-478327894782 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:18.699369 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-14f13283-1bb2-4c3d-a92e-478327894782 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.699908 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-14f13283-1bb2-4c3d-a92e-478327894782 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.700744 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-14f13283-1bb2-4c3d-a92e-478327894782 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.701633 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-14f13283-1bb2-4c3d-a92e-478327894782 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.702292 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-14f13283-1bb2-4c3d-a92e-478327894782 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.702913 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-14f13283-1bb2-4c3d-a92e-478327894782 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.839912 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4f8d92dc-dbfe-47cf-83d5-468bdf311619 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:18.841720 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-4f8d92dc-dbfe-47cf-83d5-468bdf311619 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:18.850256 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4f8d92dc-dbfe-47cf-83d5-468bdf311619 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.850752 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4f8d92dc-dbfe-47cf-83d5-468bdf311619 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.851266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4f8d92dc-dbfe-47cf-83d5-468bdf311619 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.851980 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4f8d92dc-dbfe-47cf-83d5-468bdf311619 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.852437 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4f8d92dc-dbfe-47cf-83d5-468bdf311619 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.853495 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4f8d92dc-dbfe-47cf-83d5-468bdf311619 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.946970 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-14f13283-1bb2-4c3d-a92e-478327894782 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:18.959888 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-14f13283-1bb2-4c3d-a92e-478327894782 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:18.992449 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-14f13283-1bb2-4c3d-a92e-478327894782 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:18.994283 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-14f13283-1bb2-4c3d-a92e-478327894782 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1739 microversion: 2.20 time: 0.316253 Oct 28 19:08:18.997962 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 145/304] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:18 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1739 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:19.010619 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c29f59d7-dbc1-472d-b9f7-48bda8fafa34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:19.011824 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-c29f59d7-dbc1-472d-b9f7-48bda8fafa34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:19.024179 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c29f59d7-dbc1-472d-b9f7-48bda8fafa34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:19.025013 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c29f59d7-dbc1-472d-b9f7-48bda8fafa34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:19.025676 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c29f59d7-dbc1-472d-b9f7-48bda8fafa34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:19.027019 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c29f59d7-dbc1-472d-b9f7-48bda8fafa34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:19.027641 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c29f59d7-dbc1-472d-b9f7-48bda8fafa34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:19.028280 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c29f59d7-dbc1-472d-b9f7-48bda8fafa34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:19.152438 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4f8d92dc-dbfe-47cf-83d5-468bdf311619 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:19.184737 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-4f8d92dc-dbfe-47cf-83d5-468bdf311619 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1314 microversion: 2.1 time: 0.348911 Oct 28 19:08:19.186535 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 160/305] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:18 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:19.249441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c29f59d7-dbc1-472d-b9f7-48bda8fafa34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:19.257746 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-c29f59d7-dbc1-472d-b9f7-48bda8fafa34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.258547 Oct 28 19:08:19.258338 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 146/306] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:18 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:19.530370 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-0835780a-ad2e-4554-b901-2fce79de5f05 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:19.532667 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-0835780a-ad2e-4554-b901-2fce79de5f05 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:19.577266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0835780a-ad2e-4554-b901-2fce79de5f05 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:19.578204 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0835780a-ad2e-4554-b901-2fce79de5f05 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:19.578930 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0835780a-ad2e-4554-b901-2fce79de5f05 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:19.579769 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0835780a-ad2e-4554-b901-2fce79de5f05 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:19.580485 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0835780a-ad2e-4554-b901-2fce79de5f05 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:19.581041 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0835780a-ad2e-4554-b901-2fce79de5f05 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:19.782679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-0835780a-ad2e-4554-b901-2fce79de5f05 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:19.790407 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-0835780a-ad2e-4554-b901-2fce79de5f05 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1356 microversion: 2.1 time: 0.264965 Oct 28 19:08:19.797696 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 161/307] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:19 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1356 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:20.022441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-82c3fa21-32cb-4893-acdc-d713e31f25b7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:20.023323 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-82c3fa21-32cb-4893-acdc-d713e31f25b7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:20.032605 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-82c3fa21-32cb-4893-acdc-d713e31f25b7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:20.035534 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-82c3fa21-32cb-4893-acdc-d713e31f25b7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:20.036204 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-82c3fa21-32cb-4893-acdc-d713e31f25b7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:20.037309 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-82c3fa21-32cb-4893-acdc-d713e31f25b7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:20.037981 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-82c3fa21-32cb-4893-acdc-d713e31f25b7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:20.038864 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-82c3fa21-32cb-4893-acdc-d713e31f25b7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:20.200524 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-82c3fa21-32cb-4893-acdc-d713e31f25b7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:20.213003 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-82c3fa21-32cb-4893-acdc-d713e31f25b7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:20.213247 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-d3fea1aa-7011-4c73-95bf-01ac6c232cec tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:20.214452 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-82c3fa21-32cb-4893-acdc-d713e31f25b7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:20.215661 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-82c3fa21-32cb-4893-acdc-d713e31f25b7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1739 microversion: 2.20 time: 0.197059 Oct 28 19:08:20.216264 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 147/308] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:20 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:20.228484 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-d3fea1aa-7011-4c73-95bf-01ac6c232cec tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:20.237281 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d3fea1aa-7011-4c73-95bf-01ac6c232cec tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:20.237875 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d3fea1aa-7011-4c73-95bf-01ac6c232cec tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:20.238430 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d3fea1aa-7011-4c73-95bf-01ac6c232cec tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:20.239321 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d3fea1aa-7011-4c73-95bf-01ac6c232cec tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:20.239851 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d3fea1aa-7011-4c73-95bf-01ac6c232cec tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:20.240353 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d3fea1aa-7011-4c73-95bf-01ac6c232cec tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:20.284156 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-1b60c8c3-7198-4ed1-ba45-b8039cff7428 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:20.284973 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-1b60c8c3-7198-4ed1-ba45-b8039cff7428 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:20.300900 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1b60c8c3-7198-4ed1-ba45-b8039cff7428 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:20.301651 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1b60c8c3-7198-4ed1-ba45-b8039cff7428 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:20.302486 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1b60c8c3-7198-4ed1-ba45-b8039cff7428 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:20.303446 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1b60c8c3-7198-4ed1-ba45-b8039cff7428 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:20.304297 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1b60c8c3-7198-4ed1-ba45-b8039cff7428 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:20.304919 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1b60c8c3-7198-4ed1-ba45-b8039cff7428 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:20.449641 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-d3fea1aa-7011-4c73-95bf-01ac6c232cec tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:20.457807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-d3fea1aa-7011-4c73-95bf-01ac6c232cec tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1314 microversion: 2.1 time: 0.248420 Oct 28 19:08:20.471718 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 162/309] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:20 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:20.504218 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1b60c8c3-7198-4ed1-ba45-b8039cff7428 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:20.515823 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-1b60c8c3-7198-4ed1-ba45-b8039cff7428 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.235443 Oct 28 19:08:20.532879 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 148/310] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:20 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:20.815644 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-263455a9-ff62-4f1f-b177-e1618f5cdedf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:20.816341 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-263455a9-ff62-4f1f-b177-e1618f5cdedf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:20.823298 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-263455a9-ff62-4f1f-b177-e1618f5cdedf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:20.824031 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-263455a9-ff62-4f1f-b177-e1618f5cdedf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:20.824652 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-263455a9-ff62-4f1f-b177-e1618f5cdedf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:20.826067 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-263455a9-ff62-4f1f-b177-e1618f5cdedf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:20.826850 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-263455a9-ff62-4f1f-b177-e1618f5cdedf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:20.827523 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-263455a9-ff62-4f1f-b177-e1618f5cdedf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.015319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-263455a9-ff62-4f1f-b177-e1618f5cdedf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:21.025000 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-263455a9-ff62-4f1f-b177-e1618f5cdedf tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1547 microversion: 2.1 time: 0.213215 Oct 28 19:08:21.042851 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 163/311] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:20 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1547 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:21.051883 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-09a3d606-d4a9-4cfb-9bc3-550bcb9bcde0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:21.054001 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-09a3d606-d4a9-4cfb-9bc3-550bcb9bcde0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:21.061662 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-09a3d606-d4a9-4cfb-9bc3-550bcb9bcde0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.062444 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-09a3d606-d4a9-4cfb-9bc3-550bcb9bcde0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.063541 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-09a3d606-d4a9-4cfb-9bc3-550bcb9bcde0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.064253 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-09a3d606-d4a9-4cfb-9bc3-550bcb9bcde0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.064703 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-09a3d606-d4a9-4cfb-9bc3-550bcb9bcde0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.065125 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-09a3d606-d4a9-4cfb-9bc3-550bcb9bcde0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.242613 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-09a3d606-d4a9-4cfb-9bc3-550bcb9bcde0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:21.253315 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-560ba0c4-2fe3-4a46-875e-44169798d949 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:21.253481 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-09a3d606-d4a9-4cfb-9bc3-550bcb9bcde0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1547 microversion: 2.1 time: 0.207733 Oct 28 19:08:21.254335 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 149/312] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:21 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1547 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:21.269277 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-560ba0c4-2fe3-4a46-875e-44169798d949 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:21.279701 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-6b47aa9a-ff5c-49ac-af03-ce877251ff8b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:21.279943 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-560ba0c4-2fe3-4a46-875e-44169798d949 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.280659 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-560ba0c4-2fe3-4a46-875e-44169798d949 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.281315 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-560ba0c4-2fe3-4a46-875e-44169798d949 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.282213 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-560ba0c4-2fe3-4a46-875e-44169798d949 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.282863 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-560ba0c4-2fe3-4a46-875e-44169798d949 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.283503 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-560ba0c4-2fe3-4a46-875e-44169798d949 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.286526 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-6b47aa9a-ff5c-49ac-af03-ce877251ff8b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:21.287439 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-6b47aa9a-ff5c-49ac-af03-ce877251ff8b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Searching by: {'deleted': False, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6'} {{(pid=118875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:08:21.295293 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6b47aa9a-ff5c-49ac-af03-ce877251ff8b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.295925 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6b47aa9a-ff5c-49ac-af03-ce877251ff8b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.296439 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6b47aa9a-ff5c-49ac-af03-ce877251ff8b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.297248 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6b47aa9a-ff5c-49ac-af03-ce877251ff8b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.297783 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6b47aa9a-ff5c-49ac-af03-ce877251ff8b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.298359 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6b47aa9a-ff5c-49ac-af03-ce877251ff8b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.454886 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.multi_cell_list [None req-6b47aa9a-ff5c-49ac-af03-ce877251ff8b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:08:21.494574 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-560ba0c4-2fe3-4a46-875e-44169798d949 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:21.504521 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-560ba0c4-2fe3-4a46-875e-44169798d949 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:21.510263 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-560ba0c4-2fe3-4a46-875e-44169798d949 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:21.510263 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-560ba0c4-2fe3-4a46-875e-44169798d949 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1739 microversion: 2.20 time: 0.259886 Oct 28 19:08:21.510263 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 164/313] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:21 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:08:21.515656 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-78532180-6426-4969-8b4e-c7531ce9c2f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:21.516421 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-78532180-6426-4969-8b4e-c7531ce9c2f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:21.522944 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-78532180-6426-4969-8b4e-c7531ce9c2f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.523737 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-78532180-6426-4969-8b4e-c7531ce9c2f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.524184 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-78532180-6426-4969-8b4e-c7531ce9c2f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.524895 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-78532180-6426-4969-8b4e-c7531ce9c2f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.525357 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-78532180-6426-4969-8b4e-c7531ce9c2f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.525807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-78532180-6426-4969-8b4e-c7531ce9c2f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.563510 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-6b47aa9a-ff5c-49ac-af03-ce877251ff8b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.288266 Oct 28 19:08:21.564331 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 150/314] 10.222.0.58 () {58 vars in 1125 bytes} [Fri Oct 28 19:08:21 2022] GET /compute/v2.1/servers => generated 341 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:21.574860 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-331cb46f-3d0f-45fd-9ac2-036e87a7f384 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:21.576368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-331cb46f-3d0f-45fd-9ac2-036e87a7f384 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:21.586090 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-331cb46f-3d0f-45fd-9ac2-036e87a7f384 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.586591 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-331cb46f-3d0f-45fd-9ac2-036e87a7f384 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.587066 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-331cb46f-3d0f-45fd-9ac2-036e87a7f384 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.587766 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-331cb46f-3d0f-45fd-9ac2-036e87a7f384 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.588391 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-331cb46f-3d0f-45fd-9ac2-036e87a7f384 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.588973 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-331cb46f-3d0f-45fd-9ac2-036e87a7f384 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.697374 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell0:SELECT=8 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:21.777839 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-78532180-6426-4969-8b4e-c7531ce9c2f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:21.786469 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-78532180-6426-4969-8b4e-c7531ce9c2f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1314 microversion: 2.1 time: 0.275847 Oct 28 19:08:21.799461 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 165/315] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:21 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:21.799690 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-331cb46f-3d0f-45fd-9ac2-036e87a7f384 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:21.807897 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-600ca851-9d06-44fc-aeee-eab1f71044ca tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:21.808588 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-600ca851-9d06-44fc-aeee-eab1f71044ca tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:21.811049 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-331cb46f-3d0f-45fd-9ac2-036e87a7f384 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.242898 Oct 28 19:08:21.811825 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 151/316] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:21 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:21.815777 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-600ca851-9d06-44fc-aeee-eab1f71044ca tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.816243 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-600ca851-9d06-44fc-aeee-eab1f71044ca tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.816775 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-600ca851-9d06-44fc-aeee-eab1f71044ca tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.817532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-600ca851-9d06-44fc-aeee-eab1f71044ca tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.818046 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-600ca851-9d06-44fc-aeee-eab1f71044ca tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.818529 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-600ca851-9d06-44fc-aeee-eab1f71044ca tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.974510 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-600ca851-9d06-44fc-aeee-eab1f71044ca tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:21.986233 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-600ca851-9d06-44fc-aeee-eab1f71044ca tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1547 microversion: 2.1 time: 0.185512 Oct 28 19:08:21.986832 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 166/317] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:21 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1547 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:22.534165 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-db03fb04-1af1-44a2-a6f7-d33b6839bd19 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:22.534898 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-db03fb04-1af1-44a2-a6f7-d33b6839bd19 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:22.572526 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-db03fb04-1af1-44a2-a6f7-d33b6839bd19 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:22.572963 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-db03fb04-1af1-44a2-a6f7-d33b6839bd19 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:22.573630 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-db03fb04-1af1-44a2-a6f7-d33b6839bd19 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:22.574522 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-db03fb04-1af1-44a2-a6f7-d33b6839bd19 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:22.578867 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-db03fb04-1af1-44a2-a6f7-d33b6839bd19 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:22.579354 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-db03fb04-1af1-44a2-a6f7-d33b6839bd19 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:22.724229 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-db03fb04-1af1-44a2-a6f7-d33b6839bd19 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:22.728249 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=100 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:22.734128 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-db03fb04-1af1-44a2-a6f7-d33b6839bd19 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:22.735831 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-db03fb04-1af1-44a2-a6f7-d33b6839bd19 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:22.737457 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-db03fb04-1af1-44a2-a6f7-d33b6839bd19 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1739 microversion: 2.20 time: 0.207493 Oct 28 19:08:22.738182 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 152/318] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:22 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:22.814412 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-d7df59ed-e5a9-4451-8337-e7034a4ed105 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:22.815420 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-d7df59ed-e5a9-4451-8337-e7034a4ed105 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:22.822098 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d7df59ed-e5a9-4451-8337-e7034a4ed105 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:22.823580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d7df59ed-e5a9-4451-8337-e7034a4ed105 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:22.824255 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d7df59ed-e5a9-4451-8337-e7034a4ed105 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:22.826527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d7df59ed-e5a9-4451-8337-e7034a4ed105 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:22.827191 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d7df59ed-e5a9-4451-8337-e7034a4ed105 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:22.827851 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d7df59ed-e5a9-4451-8337-e7034a4ed105 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:22.834348 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d43eef4b-3434-4d19-a1c8-f90c4ee5c1a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:22.834959 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d43eef4b-3434-4d19-a1c8-f90c4ee5c1a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:22.841842 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d43eef4b-3434-4d19-a1c8-f90c4ee5c1a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:22.842340 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d43eef4b-3434-4d19-a1c8-f90c4ee5c1a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:22.842791 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d43eef4b-3434-4d19-a1c8-f90c4ee5c1a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:22.843540 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d43eef4b-3434-4d19-a1c8-f90c4ee5c1a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:22.844181 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d43eef4b-3434-4d19-a1c8-f90c4ee5c1a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:22.844624 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d43eef4b-3434-4d19-a1c8-f90c4ee5c1a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:23.047002 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-d7df59ed-e5a9-4451-8337-e7034a4ed105 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:23.055307 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-d7df59ed-e5a9-4451-8337-e7034a4ed105 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1314 microversion: 2.1 time: 0.244782 Oct 28 19:08:23.073415 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 167/319] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:22 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:23.097083 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d43eef4b-3434-4d19-a1c8-f90c4ee5c1a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:23.105870 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d43eef4b-3434-4d19-a1c8-f90c4ee5c1a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.275493 Oct 28 19:08:23.111377 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 153/320] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:22 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:23.268019 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-fad023b9-33ca-42a5-9042-ee84e79002be tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:23.268547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-fad023b9-33ca-42a5-9042-ee84e79002be tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:23.275665 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fad023b9-33ca-42a5-9042-ee84e79002be tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:23.276411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fad023b9-33ca-42a5-9042-ee84e79002be tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:23.277011 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fad023b9-33ca-42a5-9042-ee84e79002be tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:23.278430 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fad023b9-33ca-42a5-9042-ee84e79002be tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:23.279243 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fad023b9-33ca-42a5-9042-ee84e79002be tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:23.279858 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fad023b9-33ca-42a5-9042-ee84e79002be tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:23.306219 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-fad023b9-33ca-42a5-9042-ee84e79002be tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/ips" status: 200 len: 146 microversion: 2.1 time: 0.042066 Oct 28 19:08:23.307024 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 168/321] 10.222.0.58 () {58 vars in 1248 bytes} [Fri Oct 28 19:08:23 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:23.768188 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-170bd33c-11ee-4a79-87f0-2f7c1dcbb000 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85856c7f-ed0d-46b1-befe-3881f94371a5"}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:23.772047 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-8bb11d88-668a-4960-881a-9ef989ee722f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:23.772393 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-8bb11d88-668a-4960-881a-9ef989ee722f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:23.773596 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-170bd33c-11ee-4a79-87f0-2f7c1dcbb000 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:23.779296 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8bb11d88-668a-4960-881a-9ef989ee722f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:23.779772 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8bb11d88-668a-4960-881a-9ef989ee722f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:23.780212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8bb11d88-668a-4960-881a-9ef989ee722f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:23.780938 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8bb11d88-668a-4960-881a-9ef989ee722f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:23.781610 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8bb11d88-668a-4960-881a-9ef989ee722f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:23.781761 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-170bd33c-11ee-4a79-87f0-2f7c1dcbb000 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:23.782250 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-170bd33c-11ee-4a79-87f0-2f7c1dcbb000 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:23.782533 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8bb11d88-668a-4960-881a-9ef989ee722f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:23.782675 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-170bd33c-11ee-4a79-87f0-2f7c1dcbb000 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:23.783406 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-170bd33c-11ee-4a79-87f0-2f7c1dcbb000 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:23.783857 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-170bd33c-11ee-4a79-87f0-2f7c1dcbb000 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:23.784282 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-170bd33c-11ee-4a79-87f0-2f7c1dcbb000 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:23.973358 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-8bb11d88-668a-4960-881a-9ef989ee722f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:23.983801 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-8bb11d88-668a-4960-881a-9ef989ee722f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:23.992887 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-8bb11d88-668a-4960-881a-9ef989ee722f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:23.994611 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-8bb11d88-668a-4960-881a-9ef989ee722f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1739 microversion: 2.20 time: 0.230206 Oct 28 19:08:23.995690 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 169/322] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:23 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:08:24.078840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-01f6ff5b-75c0-4121-933e-175fad7c70b3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:24.079479 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-01f6ff5b-75c0-4121-933e-175fad7c70b3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:24.090568 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-01f6ff5b-75c0-4121-933e-175fad7c70b3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:24.091879 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-01f6ff5b-75c0-4121-933e-175fad7c70b3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:24.092567 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-01f6ff5b-75c0-4121-933e-175fad7c70b3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:24.093514 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-01f6ff5b-75c0-4121-933e-175fad7c70b3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:24.094177 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-01f6ff5b-75c0-4121-933e-175fad7c70b3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:24.094822 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-01f6ff5b-75c0-4121-933e-175fad7c70b3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:24.235381 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-170bd33c-11ee-4a79-87f0-2f7c1dcbb000 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "POST /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.469296 Oct 28 19:08:24.237487 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 154/323] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Oct 28 19:08:23 2022] POST /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c/os-volume_attachments => generated 194 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:24.289625 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-01f6ff5b-75c0-4121-933e-175fad7c70b3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:24.293438 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-04b274b0-9a7a-4faa-96c2-197d9e4b1293 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:24.296077 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-04b274b0-9a7a-4faa-96c2-197d9e4b1293 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:24.301421 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-01f6ff5b-75c0-4121-933e-175fad7c70b3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1314 microversion: 2.1 time: 0.227512 Oct 28 19:08:24.315791 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-04b274b0-9a7a-4faa-96c2-197d9e4b1293 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:24.315791 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-04b274b0-9a7a-4faa-96c2-197d9e4b1293 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:24.315791 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-04b274b0-9a7a-4faa-96c2-197d9e4b1293 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:24.316296 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-04b274b0-9a7a-4faa-96c2-197d9e4b1293 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:24.318612 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-04b274b0-9a7a-4faa-96c2-197d9e4b1293 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:24.318612 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-04b274b0-9a7a-4faa-96c2-197d9e4b1293 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:24.319476 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 170/324] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:24 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:24.400383 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-3b80e1ac-ac45-4a74-9fb7-341dd58bc514 req-c076998e-fed7-4dea-a618-fd6ff4166f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebba68c-5119-44db-a52d-79e084c80e38", "name": "network-vif-plugged", "status": "completed", "tag": "80595f06-16ac-45fe-89be-88081a904fbe"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:24.417881 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-3b80e1ac-ac45-4a74-9fb7-341dd58bc514 req-c076998e-fed7-4dea-a618-fd6ff4166f58 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:24.418644 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-3b80e1ac-ac45-4a74-9fb7-341dd58bc514 req-c076998e-fed7-4dea-a618-fd6ff4166f58 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:24.419997 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-3b80e1ac-ac45-4a74-9fb7-341dd58bc514 req-c076998e-fed7-4dea-a618-fd6ff4166f58 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:24.457545 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-3b80e1ac-ac45-4a74-9fb7-341dd58bc514 req-c076998e-fed7-4dea-a618-fd6ff4166f58 service nova] Creating event network-vif-plugged:80595f06-16ac-45fe-89be-88081a904fbe for instance aebba68c-5119-44db-a52d-79e084c80e38 on hv-cinder-86236 Oct 28 19:08:24.468396 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-3b80e1ac-ac45-4a74-9fb7-341dd58bc514 req-c076998e-fed7-4dea-a618-fd6ff4166f58 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073097 Oct 28 19:08:24.470745 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 171/325] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:08:24.554381 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-04b274b0-9a7a-4faa-96c2-197d9e4b1293 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:24.572927 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-04b274b0-9a7a-4faa-96c2-197d9e4b1293 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.303051 Oct 28 19:08:24.579372 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 155/326] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:24 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:25.021498 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4650ac16-034c-401f-81fc-5562b756dcef tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:25.022201 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-4650ac16-034c-401f-81fc-5562b756dcef tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:25.028278 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4650ac16-034c-401f-81fc-5562b756dcef tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:25.028753 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4650ac16-034c-401f-81fc-5562b756dcef tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:25.029184 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4650ac16-034c-401f-81fc-5562b756dcef tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:25.029896 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4650ac16-034c-401f-81fc-5562b756dcef tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:25.030336 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4650ac16-034c-401f-81fc-5562b756dcef tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:25.030752 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4650ac16-034c-401f-81fc-5562b756dcef tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:25.163558 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4650ac16-034c-401f-81fc-5562b756dcef tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:25.172907 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4650ac16-034c-401f-81fc-5562b756dcef tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:25.174423 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4650ac16-034c-401f-81fc-5562b756dcef tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:25.175653 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-4650ac16-034c-401f-81fc-5562b756dcef tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1739 microversion: 2.20 time: 0.158430 Oct 28 19:08:25.176255 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 172/327] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:25 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:25.326680 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-ff3ce86a-5dfd-49e5-90ef-6744cbbd4864 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:25.327320 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-ff3ce86a-5dfd-49e5-90ef-6744cbbd4864 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:25.333728 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ff3ce86a-5dfd-49e5-90ef-6744cbbd4864 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:25.334217 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ff3ce86a-5dfd-49e5-90ef-6744cbbd4864 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:25.334661 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ff3ce86a-5dfd-49e5-90ef-6744cbbd4864 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:25.335389 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ff3ce86a-5dfd-49e5-90ef-6744cbbd4864 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:25.335850 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ff3ce86a-5dfd-49e5-90ef-6744cbbd4864 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:25.336283 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ff3ce86a-5dfd-49e5-90ef-6744cbbd4864 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:25.478102 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ff3ce86a-5dfd-49e5-90ef-6744cbbd4864 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:25.490102 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-ff3ce86a-5dfd-49e5-90ef-6744cbbd4864 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1314 microversion: 2.1 time: 0.167665 Oct 28 19:08:25.491071 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 156/328] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:25 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:25.596891 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-5e096842-7528-4a2c-aa6e-323cc2f21e7a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:25.597547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-5e096842-7528-4a2c-aa6e-323cc2f21e7a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:25.603447 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5e096842-7528-4a2c-aa6e-323cc2f21e7a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:25.603922 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5e096842-7528-4a2c-aa6e-323cc2f21e7a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:25.604353 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5e096842-7528-4a2c-aa6e-323cc2f21e7a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:25.605030 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5e096842-7528-4a2c-aa6e-323cc2f21e7a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:25.605476 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5e096842-7528-4a2c-aa6e-323cc2f21e7a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:25.605895 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5e096842-7528-4a2c-aa6e-323cc2f21e7a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:25.734283 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-5e096842-7528-4a2c-aa6e-323cc2f21e7a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:25.737860 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=100 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:25.742999 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-5e096842-7528-4a2c-aa6e-323cc2f21e7a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.149934 Oct 28 19:08:25.743569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 173/329] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:25 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:26.020588 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-78bae78d-0dc7-4817-9b36-a6bf604e3c90 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c578475-c4ec-47e7-babf-e13c3f4876e7"}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:26.023018 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-78bae78d-0dc7-4817-9b36-a6bf604e3c90 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:26.024991 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:26.030731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-78bae78d-0dc7-4817-9b36-a6bf604e3c90 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:26.031251 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-78bae78d-0dc7-4817-9b36-a6bf604e3c90 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:26.031699 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-78bae78d-0dc7-4817-9b36-a6bf604e3c90 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:26.032394 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-78bae78d-0dc7-4817-9b36-a6bf604e3c90 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:26.032852 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-78bae78d-0dc7-4817-9b36-a6bf604e3c90 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:26.033284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-78bae78d-0dc7-4817-9b36-a6bf604e3c90 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:26.201363 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-86829bf2-27f4-4b5c-9568-9e229c59a3a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:26.202069 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-86829bf2-27f4-4b5c-9568-9e229c59a3a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:26.208066 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86829bf2-27f4-4b5c-9568-9e229c59a3a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:26.208686 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86829bf2-27f4-4b5c-9568-9e229c59a3a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:26.209189 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86829bf2-27f4-4b5c-9568-9e229c59a3a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:26.209951 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86829bf2-27f4-4b5c-9568-9e229c59a3a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:26.210471 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86829bf2-27f4-4b5c-9568-9e229c59a3a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:26.210962 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86829bf2-27f4-4b5c-9568-9e229c59a3a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:26.353333 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-86829bf2-27f4-4b5c-9568-9e229c59a3a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:26.361950 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-86829bf2-27f4-4b5c-9568-9e229c59a3a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:26.363410 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-86829bf2-27f4-4b5c-9568-9e229c59a3a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:26.364546 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-86829bf2-27f4-4b5c-9568-9e229c59a3a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1721 microversion: 2.20 time: 0.167928 Oct 28 19:08:26.365103 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 174/330] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:26 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:08:26.513580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-0d0e3e66-4d9b-4d40-9734-1bd36eb6aabc tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:26.514257 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-0d0e3e66-4d9b-4d40-9734-1bd36eb6aabc tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:26.520115 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0d0e3e66-4d9b-4d40-9734-1bd36eb6aabc tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:26.520682 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0d0e3e66-4d9b-4d40-9734-1bd36eb6aabc tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:26.521120 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0d0e3e66-4d9b-4d40-9734-1bd36eb6aabc tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:26.521805 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0d0e3e66-4d9b-4d40-9734-1bd36eb6aabc tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:26.522238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0d0e3e66-4d9b-4d40-9734-1bd36eb6aabc tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:26.523312 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0d0e3e66-4d9b-4d40-9734-1bd36eb6aabc tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:26.651535 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-0d0e3e66-4d9b-4d40-9734-1bd36eb6aabc tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:26.659257 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-0d0e3e66-4d9b-4d40-9734-1bd36eb6aabc tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1498 microversion: 2.1 time: 0.149790 Oct 28 19:08:26.659828 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 175/331] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:26 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:26.767003 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-27a4a464-b957-4c6a-9250-1386f5fff23e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:26.767625 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-27a4a464-b957-4c6a-9250-1386f5fff23e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:26.773726 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-27a4a464-b957-4c6a-9250-1386f5fff23e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:26.774205 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-27a4a464-b957-4c6a-9250-1386f5fff23e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:26.774641 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-27a4a464-b957-4c6a-9250-1386f5fff23e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:26.775371 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-27a4a464-b957-4c6a-9250-1386f5fff23e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:26.775830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-27a4a464-b957-4c6a-9250-1386f5fff23e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:26.776257 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-27a4a464-b957-4c6a-9250-1386f5fff23e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:26.943472 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-27a4a464-b957-4c6a-9250-1386f5fff23e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:26.953628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-27a4a464-b957-4c6a-9250-1386f5fff23e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.191224 Oct 28 19:08:26.959744 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 176/332] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:26 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:27.069445 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-78bae78d-0dc7-4817-9b36-a6bf604e3c90 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "POST /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.052650 Oct 28 19:08:27.070236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 157/333] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Oct 28 19:08:26 2022] POST /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/os-volume_attachments => generated 194 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:27.258579 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1631e43f-9290-4419-bf4f-3a13fbf4d331 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:27.259112 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-1631e43f-9290-4419-bf4f-3a13fbf4d331 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:27.265331 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1631e43f-9290-4419-bf4f-3a13fbf4d331 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.265819 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1631e43f-9290-4419-bf4f-3a13fbf4d331 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.266258 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1631e43f-9290-4419-bf4f-3a13fbf4d331 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.266958 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1631e43f-9290-4419-bf4f-3a13fbf4d331 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.267434 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1631e43f-9290-4419-bf4f-3a13fbf4d331 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.267865 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1631e43f-9290-4419-bf4f-3a13fbf4d331 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.295002 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-1631e43f-9290-4419-bf4f-3a13fbf4d331 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Going to try to terminate instance {{(pid=118874) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:08:27.383064 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-1631e43f-9290-4419-bf4f-3a13fbf4d331 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "DELETE /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 204 len: 0 microversion: 2.1 time: 0.128110 Oct 28 19:08:27.383638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 177/334] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Oct 28 19:08:27 2022] DELETE /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:08:27.390970 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-f49ed7dc-11e2-4d86-bb18-4e792992f3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:27.391681 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-f49ed7dc-11e2-4d86-bb18-4e792992f3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:27.392330 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-ab9eb8ee-4f06-479d-9577-cee37a32db25 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:27.393023 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-ab9eb8ee-4f06-479d-9577-cee37a32db25 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:27.397802 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f49ed7dc-11e2-4d86-bb18-4e792992f3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.398529 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f49ed7dc-11e2-4d86-bb18-4e792992f3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.398627 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ab9eb8ee-4f06-479d-9577-cee37a32db25 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.398717 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f49ed7dc-11e2-4d86-bb18-4e792992f3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.399228 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ab9eb8ee-4f06-479d-9577-cee37a32db25 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.399469 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ab9eb8ee-4f06-479d-9577-cee37a32db25 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.399584 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f49ed7dc-11e2-4d86-bb18-4e792992f3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.399947 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f49ed7dc-11e2-4d86-bb18-4e792992f3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.400215 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ab9eb8ee-4f06-479d-9577-cee37a32db25 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.400380 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f49ed7dc-11e2-4d86-bb18-4e792992f3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.400667 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ab9eb8ee-4f06-479d-9577-cee37a32db25 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.401096 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ab9eb8ee-4f06-479d-9577-cee37a32db25 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.597054 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ab9eb8ee-4f06-479d-9577-cee37a32db25 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:27.605780 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-ab9eb8ee-4f06-479d-9577-cee37a32db25 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1504 microversion: 2.1 time: 0.217234 Oct 28 19:08:27.606690 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 178/335] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:27 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:27.609162 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-f49ed7dc-11e2-4d86-bb18-4e792992f3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:27.622283 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-f49ed7dc-11e2-4d86-bb18-4e792992f3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:27.623825 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-f49ed7dc-11e2-4d86-bb18-4e792992f3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:27.625105 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-f49ed7dc-11e2-4d86-bb18-4e792992f3f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1721 microversion: 2.20 time: 0.239161 Oct 28 19:08:27.625752 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 158/336] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:27 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:27.976990 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-0718ddbb-acbe-45a3-891c-8316c3245314 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:27.977629 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-0718ddbb-acbe-45a3-891c-8316c3245314 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:27.984004 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0718ddbb-acbe-45a3-891c-8316c3245314 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.984489 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0718ddbb-acbe-45a3-891c-8316c3245314 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.984950 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0718ddbb-acbe-45a3-891c-8316c3245314 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.985643 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0718ddbb-acbe-45a3-891c-8316c3245314 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.986309 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0718ddbb-acbe-45a3-891c-8316c3245314 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.986511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0718ddbb-acbe-45a3-891c-8316c3245314 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:28.118615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-0718ddbb-acbe-45a3-891c-8316c3245314 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:28.126807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-0718ddbb-acbe-45a3-891c-8316c3245314 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.153840 Oct 28 19:08:28.127399 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 179/337] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:27 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:28.633407 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-511dc67a-2063-4c88-94ca-ec80148d1410 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:28.634007 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-511dc67a-2063-4c88-94ca-ec80148d1410 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:28.640610 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-511dc67a-2063-4c88-94ca-ec80148d1410 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:28.641086 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-511dc67a-2063-4c88-94ca-ec80148d1410 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:28.641523 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-511dc67a-2063-4c88-94ca-ec80148d1410 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:28.642199 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-511dc67a-2063-4c88-94ca-ec80148d1410 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:28.642648 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-511dc67a-2063-4c88-94ca-ec80148d1410 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:28.643099 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-511dc67a-2063-4c88-94ca-ec80148d1410 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:28.650861 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f82df099-caac-4ae8-b2ef-6e5225a97b7d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:28.651506 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f82df099-caac-4ae8-b2ef-6e5225a97b7d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:28.657644 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f82df099-caac-4ae8-b2ef-6e5225a97b7d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:28.658306 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f82df099-caac-4ae8-b2ef-6e5225a97b7d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:28.658745 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f82df099-caac-4ae8-b2ef-6e5225a97b7d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:28.659463 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f82df099-caac-4ae8-b2ef-6e5225a97b7d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:28.659919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f82df099-caac-4ae8-b2ef-6e5225a97b7d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:28.660342 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f82df099-caac-4ae8-b2ef-6e5225a97b7d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:28.854712 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-511dc67a-2063-4c88-94ca-ec80148d1410 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:28.861917 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f82df099-caac-4ae8-b2ef-6e5225a97b7d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:28.863060 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-511dc67a-2063-4c88-94ca-ec80148d1410 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1504 microversion: 2.1 time: 0.233387 Oct 28 19:08:28.863639 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 159/338] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:28 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1504 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:28.870917 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f82df099-caac-4ae8-b2ef-6e5225a97b7d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:28.873233 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f82df099-caac-4ae8-b2ef-6e5225a97b7d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:28.874426 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f82df099-caac-4ae8-b2ef-6e5225a97b7d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1721 microversion: 2.20 time: 0.227469 Oct 28 19:08:28.874994 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 180/339] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:28 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:08:29.149612 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-e8b94b65-4ce3-41c6-8d59-18188b832605 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:29.150208 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-e8b94b65-4ce3-41c6-8d59-18188b832605 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:29.157073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e8b94b65-4ce3-41c6-8d59-18188b832605 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:29.157549 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e8b94b65-4ce3-41c6-8d59-18188b832605 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:29.157988 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e8b94b65-4ce3-41c6-8d59-18188b832605 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:29.158667 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e8b94b65-4ce3-41c6-8d59-18188b832605 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:29.159143 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e8b94b65-4ce3-41c6-8d59-18188b832605 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:29.159566 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e8b94b65-4ce3-41c6-8d59-18188b832605 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:29.288235 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-e8b94b65-4ce3-41c6-8d59-18188b832605 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:29.296421 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-e8b94b65-4ce3-41c6-8d59-18188b832605 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.150583 Oct 28 19:08:29.296997 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 160/340] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:29 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:29.885709 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-68db1aec-b722-464d-8981-28cdcc1587c2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:29.886554 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-68db1aec-b722-464d-8981-28cdcc1587c2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:29.892574 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-68db1aec-b722-464d-8981-28cdcc1587c2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:29.893681 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-68db1aec-b722-464d-8981-28cdcc1587c2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:29.894118 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-68db1aec-b722-464d-8981-28cdcc1587c2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:29.894800 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-68db1aec-b722-464d-8981-28cdcc1587c2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:29.895273 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-68db1aec-b722-464d-8981-28cdcc1587c2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:29.895691 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-68db1aec-b722-464d-8981-28cdcc1587c2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:29.899216 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-4a0d2f3c-6831-492b-886d-3e6b5fc2316f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:29.899845 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-4a0d2f3c-6831-492b-886d-3e6b5fc2316f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:29.905556 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4a0d2f3c-6831-492b-886d-3e6b5fc2316f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:29.906033 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4a0d2f3c-6831-492b-886d-3e6b5fc2316f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:29.906472 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4a0d2f3c-6831-492b-886d-3e6b5fc2316f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:29.907178 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4a0d2f3c-6831-492b-886d-3e6b5fc2316f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:29.907632 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4a0d2f3c-6831-492b-886d-3e6b5fc2316f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:29.908055 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4a0d2f3c-6831-492b-886d-3e6b5fc2316f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:30.092339 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-68db1aec-b722-464d-8981-28cdcc1587c2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:30.095584 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-4a0d2f3c-6831-492b-886d-3e6b5fc2316f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:30.103558 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-68db1aec-b722-464d-8981-28cdcc1587c2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1504 microversion: 2.1 time: 0.221603 Oct 28 19:08:30.103879 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-4a0d2f3c-6831-492b-886d-3e6b5fc2316f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:30.104559 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 181/341] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:29 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:30.105537 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-4a0d2f3c-6831-492b-886d-3e6b5fc2316f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:30.107250 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-4a0d2f3c-6831-492b-886d-3e6b5fc2316f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1721 microversion: 2.20 time: 0.211962 Oct 28 19:08:30.107787 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 161/342] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:29 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:08:30.287747 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-b5f5482b-5af2-48dd-8918-0ef68347effd req-0242f2f1-e1c1-402e-88a2-704ba1b8d873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "777c1a8e-485a-4333-a800-8586cdc8746b", "name": "network-vif-unplugged", "status": "completed", "tag": "63e7b2ed-34d6-4aba-a769-655ad469dbc0"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:30.299978 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-b5f5482b-5af2-48dd-8918-0ef68347effd req-0242f2f1-e1c1-402e-88a2-704ba1b8d873 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:30.300741 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-b5f5482b-5af2-48dd-8918-0ef68347effd req-0242f2f1-e1c1-402e-88a2-704ba1b8d873 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:30.302141 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-b5f5482b-5af2-48dd-8918-0ef68347effd req-0242f2f1-e1c1-402e-88a2-704ba1b8d873 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:30.315251 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-b5f5482b-5af2-48dd-8918-0ef68347effd req-0242f2f1-e1c1-402e-88a2-704ba1b8d873 service nova] Creating event network-vif-unplugged:63e7b2ed-34d6-4aba-a769-655ad469dbc0 for instance 777c1a8e-485a-4333-a800-8586cdc8746b on hv-cinder-86236 Oct 28 19:08:30.320993 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-27cf3712-f283-48ac-8a7e-2224f58fe716 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:30.321695 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-b5f5482b-5af2-48dd-8918-0ef68347effd req-0242f2f1-e1c1-402e-88a2-704ba1b8d873 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038021 Oct 28 19:08:30.322066 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-27cf3712-f283-48ac-8a7e-2224f58fe716 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:30.323102 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 182/343] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:30.331518 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-27cf3712-f283-48ac-8a7e-2224f58fe716 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:30.336546 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-27cf3712-f283-48ac-8a7e-2224f58fe716 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:30.337067 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-27cf3712-f283-48ac-8a7e-2224f58fe716 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:30.337802 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-27cf3712-f283-48ac-8a7e-2224f58fe716 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:30.338254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-27cf3712-f283-48ac-8a7e-2224f58fe716 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:30.338675 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-27cf3712-f283-48ac-8a7e-2224f58fe716 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:30.476195 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-27cf3712-f283-48ac-8a7e-2224f58fe716 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:30.487564 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-27cf3712-f283-48ac-8a7e-2224f58fe716 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.170819 Oct 28 19:08:30.488483 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 162/344] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:30 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:30.519124 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-ce3d1b09-69f3-406d-8758-adcb9b98a1f2 req-e6fb1297-031e-48f1-9e19-fcbdd6ffc067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebba68c-5119-44db-a52d-79e084c80e38", "name": "network-vif-deleted", "tag": "80595f06-16ac-45fe-89be-88081a904fbe"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:30.529603 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-ce3d1b09-69f3-406d-8758-adcb9b98a1f2 req-e6fb1297-031e-48f1-9e19-fcbdd6ffc067 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:30.530072 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-ce3d1b09-69f3-406d-8758-adcb9b98a1f2 req-e6fb1297-031e-48f1-9e19-fcbdd6ffc067 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:30.530496 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-ce3d1b09-69f3-406d-8758-adcb9b98a1f2 req-e6fb1297-031e-48f1-9e19-fcbdd6ffc067 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:30.541055 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-ce3d1b09-69f3-406d-8758-adcb9b98a1f2 req-e6fb1297-031e-48f1-9e19-fcbdd6ffc067 service nova] Creating event network-vif-deleted:80595f06-16ac-45fe-89be-88081a904fbe for instance aebba68c-5119-44db-a52d-79e084c80e38 on hv-cinder-86236 Oct 28 19:08:30.546372 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-ce3d1b09-69f3-406d-8758-adcb9b98a1f2 req-e6fb1297-031e-48f1-9e19-fcbdd6ffc067 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031303 Oct 28 19:08:30.546932 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 183/345] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:31.127711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-09a92e1a-4ef6-4b17-8bb1-ee1dcccae1ad tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:31.128453 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-09a92e1a-4ef6-4b17-8bb1-ee1dcccae1ad tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:31.133178 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1b6ebdce-a822-445a-9a3b-4d731e0ae490 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:31.133872 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-1b6ebdce-a822-445a-9a3b-4d731e0ae490 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:31.134487 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-09a92e1a-4ef6-4b17-8bb1-ee1dcccae1ad tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:31.134999 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-09a92e1a-4ef6-4b17-8bb1-ee1dcccae1ad tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:31.135454 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-09a92e1a-4ef6-4b17-8bb1-ee1dcccae1ad tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.136417 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-09a92e1a-4ef6-4b17-8bb1-ee1dcccae1ad tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:31.136874 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-09a92e1a-4ef6-4b17-8bb1-ee1dcccae1ad tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:31.137329 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-09a92e1a-4ef6-4b17-8bb1-ee1dcccae1ad tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.140473 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1b6ebdce-a822-445a-9a3b-4d731e0ae490 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:31.140948 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1b6ebdce-a822-445a-9a3b-4d731e0ae490 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:31.141384 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1b6ebdce-a822-445a-9a3b-4d731e0ae490 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.142067 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1b6ebdce-a822-445a-9a3b-4d731e0ae490 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:31.142544 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1b6ebdce-a822-445a-9a3b-4d731e0ae490 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:31.142964 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1b6ebdce-a822-445a-9a3b-4d731e0ae490 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.205059 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-09a92e1a-4ef6-4b17-8bb1-ee1dcccae1ad tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:31.212833 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-09a92e1a-4ef6-4b17-8bb1-ee1dcccae1ad tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1462 microversion: 2.1 time: 0.088908 Oct 28 19:08:31.213347 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 163/346] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:31 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1462 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:31.288911 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-1b6ebdce-a822-445a-9a3b-4d731e0ae490 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:31.297516 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-1b6ebdce-a822-445a-9a3b-4d731e0ae490 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:31.298974 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-1b6ebdce-a822-445a-9a3b-4d731e0ae490 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:31.300177 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-1b6ebdce-a822-445a-9a3b-4d731e0ae490 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1721 microversion: 2.20 time: 0.171112 Oct 28 19:08:31.300704 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 184/347] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:31 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:08:31.511696 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-fa580b17-1546-448a-8c5a-a9d89ee05d1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:31.512329 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-fa580b17-1546-448a-8c5a-a9d89ee05d1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:31.514726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell0:SELECT=4 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:31.520425 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fa580b17-1546-448a-8c5a-a9d89ee05d1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:31.520907 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fa580b17-1546-448a-8c5a-a9d89ee05d1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:31.521349 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fa580b17-1546-448a-8c5a-a9d89ee05d1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.522040 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fa580b17-1546-448a-8c5a-a9d89ee05d1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:31.522489 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fa580b17-1546-448a-8c5a-a9d89ee05d1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:31.522945 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fa580b17-1546-448a-8c5a-a9d89ee05d1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.649198 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-fa580b17-1546-448a-8c5a-a9d89ee05d1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:31.657737 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-fa580b17-1546-448a-8c5a-a9d89ee05d1b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.150093 Oct 28 19:08:31.658561 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 164/348] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:31 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:32.236611 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f4fc239b-75b5-4bd7-8438-5bc683452adb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:32.237211 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f4fc239b-75b5-4bd7-8438-5bc683452adb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:32.243098 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f4fc239b-75b5-4bd7-8438-5bc683452adb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:32.243574 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f4fc239b-75b5-4bd7-8438-5bc683452adb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:32.244002 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f4fc239b-75b5-4bd7-8438-5bc683452adb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:32.244675 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f4fc239b-75b5-4bd7-8438-5bc683452adb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:32.245116 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f4fc239b-75b5-4bd7-8438-5bc683452adb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:32.245530 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f4fc239b-75b5-4bd7-8438-5bc683452adb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:32.305916 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f4fc239b-75b5-4bd7-8438-5bc683452adb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:32.314113 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f4fc239b-75b5-4bd7-8438-5bc683452adb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1299 microversion: 2.1 time: 0.081399 Oct 28 19:08:32.314665 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 185/349] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:32 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:32.325529 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b390e8d9-0100-40a0-993b-a7fe5f10b8ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:32.326156 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b390e8d9-0100-40a0-993b-a7fe5f10b8ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:32.332025 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b390e8d9-0100-40a0-993b-a7fe5f10b8ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:32.332501 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b390e8d9-0100-40a0-993b-a7fe5f10b8ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:32.332935 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b390e8d9-0100-40a0-993b-a7fe5f10b8ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:32.333617 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b390e8d9-0100-40a0-993b-a7fe5f10b8ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:32.334065 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b390e8d9-0100-40a0-993b-a7fe5f10b8ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:32.334485 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b390e8d9-0100-40a0-993b-a7fe5f10b8ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:32.466456 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b390e8d9-0100-40a0-993b-a7fe5f10b8ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:32.475528 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b390e8d9-0100-40a0-993b-a7fe5f10b8ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:32.477001 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b390e8d9-0100-40a0-993b-a7fe5f10b8ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:32.479163 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b390e8d9-0100-40a0-993b-a7fe5f10b8ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1721 microversion: 2.20 time: 0.157394 Oct 28 19:08:32.479732 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 165/350] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:32 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:32.681535 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-27557741-364c-4feb-89aa-f0bdd17593ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:32.682049 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-27557741-364c-4feb-89aa-f0bdd17593ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:32.688765 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-27557741-364c-4feb-89aa-f0bdd17593ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:32.689279 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-27557741-364c-4feb-89aa-f0bdd17593ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:32.689714 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-27557741-364c-4feb-89aa-f0bdd17593ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:32.690455 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-27557741-364c-4feb-89aa-f0bdd17593ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:32.690902 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-27557741-364c-4feb-89aa-f0bdd17593ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:32.691363 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-27557741-364c-4feb-89aa-f0bdd17593ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:32.819860 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-27557741-364c-4feb-89aa-f0bdd17593ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:32.828159 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-27557741-364c-4feb-89aa-f0bdd17593ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1502 microversion: 2.1 time: 0.150661 Oct 28 19:08:32.828719 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 186/351] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:32 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:32.850145 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-736b5165-397f-4126-8fc1-8bd0bfaed5f6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c13e73f-6784-4019-b927-1483dec1b15f"}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:32.852681 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-736b5165-397f-4126-8fc1-8bd0bfaed5f6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:32.859594 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-736b5165-397f-4126-8fc1-8bd0bfaed5f6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:32.860148 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-736b5165-397f-4126-8fc1-8bd0bfaed5f6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:32.860655 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-736b5165-397f-4126-8fc1-8bd0bfaed5f6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:32.861414 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-736b5165-397f-4126-8fc1-8bd0bfaed5f6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:32.861955 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-736b5165-397f-4126-8fc1-8bd0bfaed5f6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:32.862448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-736b5165-397f-4126-8fc1-8bd0bfaed5f6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:32.886828 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.wsgi [None req-736b5165-397f-4126-8fc1-8bd0bfaed5f6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] HTTP exception thrown: Cannot 'attach_volume' instance 713b7fcb-dff0-4d52-b071-05b218732625 while it is in vm_state rescued Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-736b5165-397f-4126-8fc1-8bd0bfaed5f6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Request method failure captured: Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: request: POST /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625/os-volume_attachments HTTP/1.1 Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept: application/json Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept-Encoding: identity Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Connection: close Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Length: 74 Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Type: application/json Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Host: 10.222.0.58 Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Openstack-System-Scope: None Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Auth-Token: gAAAAABjXCglU6keeyc9TPFu8kh2CtSTL27mYzieTeXTMg3qjeLwWS58Om5L1-wzv5iwcJqqpWrZlbacG63VxxUqEcwRqSRGut_CvjvYM0Iq9ARpxZRlx9JGTssQ2QQL0BA1xD17zsswm8pySHHhA5LPoDCKLfH2eOnw8zYt795C9xWjuK8UoFU Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Id: None Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Name: None Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Identity-Status: Confirmed Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Is-Admin-Project: True Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Id: default Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Name: Default Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Id: 4f6c133d9594455182ac1b9ce13df65c Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-136875089 Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Role: member,reader Oct 28 19:08:32.888544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Roles: member,reader Oct 28 19:08:32.890073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:08:32.890073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant: tempest-ServerRescueNegativeTestJSON-136875089 Oct 28 19:08:32.890073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Id: 4f6c133d9594455182ac1b9ce13df65c Oct 28 19:08:32.890073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-136875089 Oct 28 19:08:32.890073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User: tempest-ServerRescueNegativeTestJSON-136875089-project Oct 28 19:08:32.890073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Id: default Oct 28 19:08:32.890073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Name: Default Oct 28 19:08:32.890073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Id: c8ca34fc5c5743d0b5e3f4f97ae285e0 Oct 28 19:08:32.890073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Name: tempest-ServerRescueNegativeTestJSON-136875089-project Oct 28 19:08:32.890073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Oct 28 19:08:32.890073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: {"volumeAttachment": {"volumeId": "3c13e73f-6784-4019-b927-1483dec1b15f"}} Oct 28 19:08:32.890073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: method: > Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: exception: Cannot 'attach_volume' instance 713b7fcb-dff0-4d52-b071-05b218732625 while it is in vm_state rescued Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: action_args: {'server_id': '713b7fcb-dff0-4d52-b071-05b218732625', 'body': {'volumeAttachment': {'volumeId': '3c13e73f-6784-4019-b927-1483dec1b15f'}}} Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 713b7fcb-dff0-4d52-b071-05b218732625 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:32.894368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 713b7fcb-dff0-4d52-b071-05b218732625 while it is in vm_state rescued Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:32.895687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:32.896765 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:32.896765 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:32.896765 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 713b7fcb-dff0-4d52-b071-05b218732625 while it is in vm_state rescued Oct 28 19:08:32.896765 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:08:32.896765 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-736b5165-397f-4126-8fc1-8bd0bfaed5f6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Returning 409 to user: Cannot 'attach_volume' instance 713b7fcb-dff0-4d52-b071-05b218732625 while it is in vm_state rescued {{(pid=118875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:32.896765 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-736b5165-397f-4126-8fc1-8bd0bfaed5f6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "POST /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044026 Oct 28 19:08:32.896765 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 166/352] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Oct 28 19:08:32 2022] POST /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:08:32.898784 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-13d084e5-138f-4e40-ba42-fa239bc98adb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:32.899343 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-13d084e5-138f-4e40-ba42-fa239bc98adb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:32.905245 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-13d084e5-138f-4e40-ba42-fa239bc98adb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:32.905716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-13d084e5-138f-4e40-ba42-fa239bc98adb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:32.906148 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-13d084e5-138f-4e40-ba42-fa239bc98adb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:32.906828 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-13d084e5-138f-4e40-ba42-fa239bc98adb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:32.907304 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-13d084e5-138f-4e40-ba42-fa239bc98adb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:32.907728 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-13d084e5-138f-4e40-ba42-fa239bc98adb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:32.971750 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-13d084e5-138f-4e40-ba42-fa239bc98adb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "POST /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625/action" status: 202 len: 0 microversion: 2.1 time: 0.076545 Oct 28 19:08:32.972563 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 187/353] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Oct 28 19:08:32 2022] POST /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:08:32.980454 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-37f3c262-4a6b-4b4a-acc0-0dd3a20c0a6c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:32.981616 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-37f3c262-4a6b-4b4a-acc0-0dd3a20c0a6c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:32.987525 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-37f3c262-4a6b-4b4a-acc0-0dd3a20c0a6c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:32.988000 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-37f3c262-4a6b-4b4a-acc0-0dd3a20c0a6c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:32.988458 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-37f3c262-4a6b-4b4a-acc0-0dd3a20c0a6c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:32.989143 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-37f3c262-4a6b-4b4a-acc0-0dd3a20c0a6c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:32.989596 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-37f3c262-4a6b-4b4a-acc0-0dd3a20c0a6c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:32.990019 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-37f3c262-4a6b-4b4a-acc0-0dd3a20c0a6c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:32.993875 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:33.119139 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-37f3c262-4a6b-4b4a-acc0-0dd3a20c0a6c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:33.127530 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-37f3c262-4a6b-4b4a-acc0-0dd3a20c0a6c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1510 microversion: 2.1 time: 0.150928 Oct 28 19:08:33.128095 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 167/354] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:32 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:33.336484 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-6f0fd174-8ebf-4926-9b83-1f1399d45b18 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:33.337177 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-6f0fd174-8ebf-4926-9b83-1f1399d45b18 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:33.343327 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6f0fd174-8ebf-4926-9b83-1f1399d45b18 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:33.343807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6f0fd174-8ebf-4926-9b83-1f1399d45b18 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:33.344241 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6f0fd174-8ebf-4926-9b83-1f1399d45b18 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:33.344923 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6f0fd174-8ebf-4926-9b83-1f1399d45b18 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:33.345370 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6f0fd174-8ebf-4926-9b83-1f1399d45b18 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:33.345796 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6f0fd174-8ebf-4926-9b83-1f1399d45b18 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:33.375715 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6f0fd174-8ebf-4926-9b83-1f1399d45b18 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:33.376184 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6f0fd174-8ebf-4926-9b83-1f1399d45b18 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:33.376611 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6f0fd174-8ebf-4926-9b83-1f1399d45b18 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:33.377042 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.objects.instance [None req-6f0fd174-8ebf-4926-9b83-1f1399d45b18 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lazy-loading 'fault' on Instance uuid aebba68c-5119-44db-a52d-79e084c80e38 {{(pid=118874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:08:33.423107 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-6f0fd174-8ebf-4926-9b83-1f1399d45b18 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:33.426871 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:33.432680 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-6f0fd174-8ebf-4926-9b83-1f1399d45b18 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1304 microversion: 2.1 time: 0.100342 Oct 28 19:08:33.433248 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 188/355] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:33 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:33.504455 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-2317f036-d06c-4fa1-bccc-bf2d6af5ea3f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:33.505092 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-2317f036-d06c-4fa1-bccc-bf2d6af5ea3f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:33.511397 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2317f036-d06c-4fa1-bccc-bf2d6af5ea3f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:33.511866 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2317f036-d06c-4fa1-bccc-bf2d6af5ea3f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:33.512893 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2317f036-d06c-4fa1-bccc-bf2d6af5ea3f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:33.513586 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2317f036-d06c-4fa1-bccc-bf2d6af5ea3f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:33.514049 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2317f036-d06c-4fa1-bccc-bf2d6af5ea3f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:33.514453 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2317f036-d06c-4fa1-bccc-bf2d6af5ea3f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:33.657709 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2317f036-d06c-4fa1-bccc-bf2d6af5ea3f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:33.665790 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2317f036-d06c-4fa1-bccc-bf2d6af5ea3f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:33.667305 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2317f036-d06c-4fa1-bccc-bf2d6af5ea3f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:33.668993 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-2317f036-d06c-4fa1-bccc-bf2d6af5ea3f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1724 microversion: 2.20 time: 0.167891 Oct 28 19:08:33.669582 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 168/356] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:33 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:33.699254 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-91050638-3f04-471a-bb69-25b0b8a03cd8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bffc40a0-af8a-479d-8616-8c15bd0780fa"}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:33.701706 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-91050638-3f04-471a-bb69-25b0b8a03cd8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:33.709241 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-91050638-3f04-471a-bb69-25b0b8a03cd8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:33.709719 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-91050638-3f04-471a-bb69-25b0b8a03cd8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:33.710152 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-91050638-3f04-471a-bb69-25b0b8a03cd8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:33.710834 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-91050638-3f04-471a-bb69-25b0b8a03cd8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:33.711334 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-91050638-3f04-471a-bb69-25b0b8a03cd8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:33.711757 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-91050638-3f04-471a-bb69-25b0b8a03cd8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.006541 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-91050638-3f04-471a-bb69-25b0b8a03cd8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "POST /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.311273 Oct 28 19:08:34.007192 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 189/357] 10.222.0.58 () {62 vars in 1364 bytes} [Fri Oct 28 19:08:33 2022] POST /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments => generated 188 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:08:34.150004 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-eadacaf0-c43d-4842-8041-47347fb25dc9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:34.150698 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-eadacaf0-c43d-4842-8041-47347fb25dc9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:34.155983 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-c266c452-0190-4523-9630-98bfe08b29f5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:34.156569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-c266c452-0190-4523-9630-98bfe08b29f5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:34.157644 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eadacaf0-c43d-4842-8041-47347fb25dc9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:34.158159 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eadacaf0-c43d-4842-8041-47347fb25dc9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:34.158604 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eadacaf0-c43d-4842-8041-47347fb25dc9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.159315 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eadacaf0-c43d-4842-8041-47347fb25dc9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:34.159770 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eadacaf0-c43d-4842-8041-47347fb25dc9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:34.160194 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eadacaf0-c43d-4842-8041-47347fb25dc9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.162859 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c266c452-0190-4523-9630-98bfe08b29f5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:34.163379 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c266c452-0190-4523-9630-98bfe08b29f5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:34.163817 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c266c452-0190-4523-9630-98bfe08b29f5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.164502 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c266c452-0190-4523-9630-98bfe08b29f5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:34.164953 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c266c452-0190-4523-9630-98bfe08b29f5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:34.165383 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c266c452-0190-4523-9630-98bfe08b29f5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.219043 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-c266c452-0190-4523-9630-98bfe08b29f5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118874) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 19:08:34.236017 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:34.294416 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-c266c452-0190-4523-9630-98bfe08b29f5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "POST /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/action" status: 202 len: 0 microversion: 2.20 time: 0.142132 Oct 28 19:08:34.298279 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 190/358] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Oct 28 19:08:34 2022] POST /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:08:34.298409 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-eadacaf0-c43d-4842-8041-47347fb25dc9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:34.303781 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-af9d6d1d-4d32-44b2-9ba1-850e716925c4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:34.304382 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-af9d6d1d-4d32-44b2-9ba1-850e716925c4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:34.306592 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-eadacaf0-c43d-4842-8041-47347fb25dc9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1510 microversion: 2.1 time: 0.160287 Oct 28 19:08:34.310840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-af9d6d1d-4d32-44b2-9ba1-850e716925c4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:34.311430 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-af9d6d1d-4d32-44b2-9ba1-850e716925c4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:34.311866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-af9d6d1d-4d32-44b2-9ba1-850e716925c4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.312560 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-af9d6d1d-4d32-44b2-9ba1-850e716925c4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:34.313070 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-af9d6d1d-4d32-44b2-9ba1-850e716925c4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:34.313503 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-af9d6d1d-4d32-44b2-9ba1-850e716925c4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.319152 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 169/359] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:34 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:34.452703 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-af9d6d1d-4d32-44b2-9ba1-850e716925c4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:34.458714 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-283cdb7a-a932-4a9f-81b4-e53ed38c7ef3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:34.459592 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-283cdb7a-a932-4a9f-81b4-e53ed38c7ef3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:34.467809 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-283cdb7a-a932-4a9f-81b4-e53ed38c7ef3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:34.468439 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-283cdb7a-a932-4a9f-81b4-e53ed38c7ef3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:34.468998 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-283cdb7a-a932-4a9f-81b4-e53ed38c7ef3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.469984 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-283cdb7a-a932-4a9f-81b4-e53ed38c7ef3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:34.470550 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-283cdb7a-a932-4a9f-81b4-e53ed38c7ef3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:34.471115 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-283cdb7a-a932-4a9f-81b4-e53ed38c7ef3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.472974 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-af9d6d1d-4d32-44b2-9ba1-850e716925c4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:34.474679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-af9d6d1d-4d32-44b2-9ba1-850e716925c4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:34.476438 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-af9d6d1d-4d32-44b2-9ba1-850e716925c4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1810 microversion: 2.20 time: 0.176587 Oct 28 19:08:34.477184 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 191/360] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:34 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:34.523656 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-283cdb7a-a932-4a9f-81b4-e53ed38c7ef3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:34.525160 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-283cdb7a-a932-4a9f-81b4-e53ed38c7ef3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:34.526551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-283cdb7a-a932-4a9f-81b4-e53ed38c7ef3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.527261 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.objects.instance [None req-283cdb7a-a932-4a9f-81b4-e53ed38c7ef3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lazy-loading 'fault' on Instance uuid aebba68c-5119-44db-a52d-79e084c80e38 {{(pid=118875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:08:34.597531 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-283cdb7a-a932-4a9f-81b4-e53ed38c7ef3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:34.606899 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-283cdb7a-a932-4a9f-81b4-e53ed38c7ef3 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 200 len: 1304 microversion: 2.1 time: 0.153055 Oct 28 19:08:34.627197 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 170/361] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:34 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 1304 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:35.107694 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-ddf79c8d-ff4f-448b-9c9b-159385a456a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:35.108294 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-ddf79c8d-ff4f-448b-9c9b-159385a456a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:35.114180 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ddf79c8d-ff4f-448b-9c9b-159385a456a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:35.114653 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ddf79c8d-ff4f-448b-9c9b-159385a456a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:35.115115 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ddf79c8d-ff4f-448b-9c9b-159385a456a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:35.115793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ddf79c8d-ff4f-448b-9c9b-159385a456a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:35.116239 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ddf79c8d-ff4f-448b-9c9b-159385a456a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:35.116659 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ddf79c8d-ff4f-448b-9c9b-159385a456a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:35.256958 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ddf79c8d-ff4f-448b-9c9b-159385a456a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:35.267107 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-ddf79c8d-ff4f-448b-9c9b-159385a456a6 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1593 microversion: 2.1 time: 0.163082 Oct 28 19:08:35.271601 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 192/362] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:35 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1593 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:35.330244 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-82f6ce8a-e40f-430f-9e9d-7a793231a76c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:35.330878 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-82f6ce8a-e40f-430f-9e9d-7a793231a76c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:35.338341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-82f6ce8a-e40f-430f-9e9d-7a793231a76c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:35.338832 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-82f6ce8a-e40f-430f-9e9d-7a793231a76c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:35.339478 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-82f6ce8a-e40f-430f-9e9d-7a793231a76c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:35.340897 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-82f6ce8a-e40f-430f-9e9d-7a793231a76c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:35.341508 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-82f6ce8a-e40f-430f-9e9d-7a793231a76c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:35.342097 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-82f6ce8a-e40f-430f-9e9d-7a793231a76c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:35.503541 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-3e075189-cfbd-4b27-a379-25aa80be587e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:35.504155 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-3e075189-cfbd-4b27-a379-25aa80be587e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:35.510370 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3e075189-cfbd-4b27-a379-25aa80be587e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:35.511155 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3e075189-cfbd-4b27-a379-25aa80be587e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:35.511586 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3e075189-cfbd-4b27-a379-25aa80be587e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:35.512848 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3e075189-cfbd-4b27-a379-25aa80be587e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:35.513299 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3e075189-cfbd-4b27-a379-25aa80be587e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:35.513716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3e075189-cfbd-4b27-a379-25aa80be587e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:35.521519 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-82f6ce8a-e40f-430f-9e9d-7a793231a76c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:35.529611 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-82f6ce8a-e40f-430f-9e9d-7a793231a76c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1510 microversion: 2.1 time: 0.203225 Oct 28 19:08:35.531081 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 171/363] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:35 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:35.630329 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-f4715831-0a5b-4b46-aeb3-d634b3762862 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:35.631180 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-f4715831-0a5b-4b46-aeb3-d634b3762862 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: aebba68c-5119-44db-a52d-79e084c80e38] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:35.639239 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f4715831-0a5b-4b46-aeb3-d634b3762862 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:35.639894 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f4715831-0a5b-4b46-aeb3-d634b3762862 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:35.640447 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f4715831-0a5b-4b46-aeb3-d634b3762862 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:35.641175 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f4715831-0a5b-4b46-aeb3-d634b3762862 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:35.641826 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f4715831-0a5b-4b46-aeb3-d634b3762862 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:35.642290 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f4715831-0a5b-4b46-aeb3-d634b3762862 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:35.652306 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3e075189-cfbd-4b27-a379-25aa80be587e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:35.657099 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.wsgi [None req-f4715831-0a5b-4b46-aeb3-d634b3762862 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] HTTP exception thrown: Instance aebba68c-5119-44db-a52d-79e084c80e38 could not be found. Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-f4715831-0a5b-4b46-aeb3-d634b3762862 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Request method failure captured: Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: request: GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 HTTP/1.1 Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept: application/json Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept-Encoding: identity Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Connection: close Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Length: 0 Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Type: application/json Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Host: 10.222.0.58 Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Openstack-System-Scope: None Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Auth-Token: gAAAAABjXCiXJgGzwG2Nbn5_Ptuv1d94zPW3knPnGsJsbndGmnhsydZH5cOPBJ8ndC1XRIDtQFmzz6svv77gnYcf1Es4jOO_Fz9nun0qSTnf30lfcQHV8XZ5xVTV9prsNbH-K09IbTRbkCVuWRvEyaRVtTLxwHwU_f01yHcCZVTyid3vdlOjFVA Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Id: None Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Name: None Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Identity-Status: Confirmed Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Is-Admin-Project: True Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Id: default Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Name: Default Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Id: 0121d8f74bf441afb820f567988c4d97 Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Name: tempest-VolumesActionsTest-45974856 Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Role: member,reader Oct 28 19:08:35.661426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Roles: member,reader Oct 28 19:08:35.662704 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0121d8f74bf441afb820f567988c4d97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0121d8f74bf441afb820f567988c4d97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0121d8f74bf441afb820f567988c4d97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0121d8f74bf441afb820f567988c4d97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:08:35.662704 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant: tempest-VolumesActionsTest-45974856 Oct 28 19:08:35.662704 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Id: 0121d8f74bf441afb820f567988c4d97 Oct 28 19:08:35.662704 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Name: tempest-VolumesActionsTest-45974856 Oct 28 19:08:35.662704 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User: tempest-VolumesActionsTest-45974856-project Oct 28 19:08:35.662704 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Id: default Oct 28 19:08:35.662704 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Name: Default Oct 28 19:08:35.662704 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Id: 8c9a97e40b054a3fad1bd12e80c26708 Oct 28 19:08:35.662704 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Name: tempest-VolumesActionsTest-45974856-project Oct 28 19:08:35.662704 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: method: > Oct 28 19:08:35.662704 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: exception: Instance aebba68c-5119-44db-a52d-79e084c80e38 could not be found. Oct 28 19:08:35.662704 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: action_args: {'id': 'aebba68c-5119-44db-a52d-79e084c80e38'} Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebba68c-5119-44db-a52d-79e084c80e38 could not be found. Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:35.663479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:35.664645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:35.664645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:08:35.664645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:08:35.664645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:08:35.664645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:08:35.664645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:08:35.664645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:08:35.664645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebba68c-5119-44db-a52d-79e084c80e38 could not be found. Oct 28 19:08:35.664645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:08:35.664645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:35.664645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:08:35.664645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:35.664645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:35.664645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:35.664645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:35.664645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:35.664645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebba68c-5119-44db-a52d-79e084c80e38 could not be found. Oct 28 19:08:35.664645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:08:35.665745 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-f4715831-0a5b-4b46-aeb3-d634b3762862 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Returning 404 to user: Instance aebba68c-5119-44db-a52d-79e084c80e38 could not be found. {{(pid=118875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:35.665745 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-f4715831-0a5b-4b46-aeb3-d634b3762862 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38" status: 404 len: 111 microversion: 2.1 time: 0.036571 Oct 28 19:08:35.667039 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 172/364] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:35 2022] GET /compute/v2.1/servers/aebba68c-5119-44db-a52d-79e084c80e38 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:08:35.679430 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3e075189-cfbd-4b27-a379-25aa80be587e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:35.681791 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3e075189-cfbd-4b27-a379-25aa80be587e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:35.685688 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-3e075189-cfbd-4b27-a379-25aa80be587e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1750 microversion: 2.20 time: 0.184546 Oct 28 19:08:35.686567 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 193/365] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:35 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1750 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:08:35.787618 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-3a36e2ea-d2bb-4046-9d79-9a64a571d0bb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1197549822", "imageRef": "cd92a575-ed0d-417b-b416-3471be3ba100", "flavorRef": "452", "networks": [{"uuid": "e64b3a9c-06ad-4be0-880a-ebf32d167ac7"}]}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:35.845486 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.network.neutron [None req-3a36e2ea-d2bb-4046-9d79-9a64a571d0bb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] validate_networks() for [('e64b3a9c-06ad-4be0-880a-ebf32d167ac7', None, None, None, None, None)] {{(pid=118875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:08:36.238461 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-3a36e2ea-d2bb-4046-9d79-9a64a571d0bb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Flavor limits 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:08:36.238886 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-3a36e2ea-d2bb-4046-9d79-9a64a571d0bb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Image limits 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:08:36.239482 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-3a36e2ea-d2bb-4046-9d79-9a64a571d0bb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Flavor pref 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:08:36.239860 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-3a36e2ea-d2bb-4046-9d79-9a64a571d0bb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Image pref 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:08:36.240627 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-3a36e2ea-d2bb-4046-9d79-9a64a571d0bb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:08:36.261801 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3a36e2ea-d2bb-4046-9d79-9a64a571d0bb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:36.262396 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3a36e2ea-d2bb-4046-9d79-9a64a571d0bb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:36.263079 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3a36e2ea-d2bb-4046-9d79-9a64a571d0bb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:36.263903 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3a36e2ea-d2bb-4046-9d79-9a64a571d0bb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:36.264629 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3a36e2ea-d2bb-4046-9d79-9a64a571d0bb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:36.265127 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3a36e2ea-d2bb-4046-9d79-9a64a571d0bb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:36.283096 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-3a36e2ea-d2bb-4046-9d79-9a64a571d0bb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Getting quotas for project 0121d8f74bf441afb820f567988c4d97. Resources: {'ram', 'instances', 'cores'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:08:36.294534 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-3a36e2ea-d2bb-4046-9d79-9a64a571d0bb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Getting quotas for user 8c9a97e40b054a3fad1bd12e80c26708 and project 0121d8f74bf441afb820f567988c4d97. Resources: {'ram', 'instances', 'cores'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:08:36.323331 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-3a36e2ea-d2bb-4046-9d79-9a64a571d0bb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Going to run 1 instances... {{(pid=118875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:08:36.323331 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-3a36e2ea-d2bb-4046-9d79-9a64a571d0bb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd92a575-ed0d-417b-b416-3471be3ba100',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:08:36.364053 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-3a36e2ea-d2bb-4046-9d79-9a64a571d0bb tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580329 Oct 28 19:08:36.365008 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 173/366] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Oct 28 19:08:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:08:36.375966 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-c6284183-d862-406e-8648-6edcc8d33499 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:36.376573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-c6284183-d862-406e-8648-6edcc8d33499 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:36.436249 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-c6284183-d862-406e-8648-6edcc8d33499 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:36.443735 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-c6284183-d862-406e-8648-6edcc8d33499 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1214 microversion: 2.1 time: 0.071712 Oct 28 19:08:36.444509 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 194/367] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:36 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:36.554550 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-9bfad5da-a38d-443b-81ae-6995206db511 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:36.555310 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-9bfad5da-a38d-443b-81ae-6995206db511 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:36.564797 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9bfad5da-a38d-443b-81ae-6995206db511 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:36.565564 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9bfad5da-a38d-443b-81ae-6995206db511 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:36.566223 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9bfad5da-a38d-443b-81ae-6995206db511 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:36.567297 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9bfad5da-a38d-443b-81ae-6995206db511 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:36.567784 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9bfad5da-a38d-443b-81ae-6995206db511 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:36.568214 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9bfad5da-a38d-443b-81ae-6995206db511 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:36.712361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a3ef838f-cc70-4fd5-8d3b-f895eb6f79ab tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:36.712985 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-a3ef838f-cc70-4fd5-8d3b-f895eb6f79ab tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:36.725650 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a3ef838f-cc70-4fd5-8d3b-f895eb6f79ab tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:36.729150 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a3ef838f-cc70-4fd5-8d3b-f895eb6f79ab tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:36.729704 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a3ef838f-cc70-4fd5-8d3b-f895eb6f79ab tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:36.731479 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a3ef838f-cc70-4fd5-8d3b-f895eb6f79ab tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:36.731828 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a3ef838f-cc70-4fd5-8d3b-f895eb6f79ab tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:36.732443 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a3ef838f-cc70-4fd5-8d3b-f895eb6f79ab tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:36.783221 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-9bfad5da-a38d-443b-81ae-6995206db511 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:36.798292 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-9bfad5da-a38d-443b-81ae-6995206db511 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1510 microversion: 2.1 time: 0.247977 Oct 28 19:08:36.804348 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 174/368] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:36 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1510 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:36.945028 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-a3ef838f-cc70-4fd5-8d3b-f895eb6f79ab tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:36.955032 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-a3ef838f-cc70-4fd5-8d3b-f895eb6f79ab tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:36.956761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-a3ef838f-cc70-4fd5-8d3b-f895eb6f79ab tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:36.958060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-a3ef838f-cc70-4fd5-8d3b-f895eb6f79ab tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1750 microversion: 2.20 time: 0.250216 Oct 28 19:08:36.958617 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 195/369] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:36 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1750 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:08:37.467102 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-cedf1670-0f7c-41e1-a0fe-5e1388582928 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:37.467692 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-cedf1670-0f7c-41e1-a0fe-5e1388582928 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:37.475765 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cedf1670-0f7c-41e1-a0fe-5e1388582928 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:37.476549 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cedf1670-0f7c-41e1-a0fe-5e1388582928 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:37.477186 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cedf1670-0f7c-41e1-a0fe-5e1388582928 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:37.479524 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cedf1670-0f7c-41e1-a0fe-5e1388582928 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:37.480638 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cedf1670-0f7c-41e1-a0fe-5e1388582928 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:37.481285 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cedf1670-0f7c-41e1-a0fe-5e1388582928 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:37.577475 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-15f16d00-da49-4bfe-a989-501408f58a78 req-6d47d090-a140-45cf-88fd-7e82fcde9ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be43ea5-02f7-43db-8ac7-df770da3592c", "tag": "6c0693d1-2c4b-4d7e-952e-42bbac4297f8"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:37.592634 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-cedf1670-0f7c-41e1-a0fe-5e1388582928 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:37.593228 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-15f16d00-da49-4bfe-a989-501408f58a78 req-6d47d090-a140-45cf-88fd-7e82fcde9ff2 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:37.594280 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-15f16d00-da49-4bfe-a989-501408f58a78 req-6d47d090-a140-45cf-88fd-7e82fcde9ff2 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:37.594723 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-15f16d00-da49-4bfe-a989-501408f58a78 req-6d47d090-a140-45cf-88fd-7e82fcde9ff2 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:37.607469 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-15f16d00-da49-4bfe-a989-501408f58a78 req-6d47d090-a140-45cf-88fd-7e82fcde9ff2 service nova] Creating event network-changed:6c0693d1-2c4b-4d7e-952e-42bbac4297f8 for instance 6be43ea5-02f7-43db-8ac7-df770da3592c on hv-cinder-86236 Oct 28 19:08:37.609563 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-cedf1670-0f7c-41e1-a0fe-5e1388582928 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1218 microversion: 2.1 time: 0.143540 Oct 28 19:08:37.610292 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 175/370] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:37 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:37.625833 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-15f16d00-da49-4bfe-a989-501408f58a78 req-6d47d090-a140-45cf-88fd-7e82fcde9ff2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052303 Oct 28 19:08:37.627368 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 196/371] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:08:37.827973 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-ec2add48-428d-4522-bc43-d9a4e62f896f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:37.828585 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-ec2add48-428d-4522-bc43-d9a4e62f896f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:37.863374 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ec2add48-428d-4522-bc43-d9a4e62f896f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:37.874221 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ec2add48-428d-4522-bc43-d9a4e62f896f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:37.874825 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ec2add48-428d-4522-bc43-d9a4e62f896f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:37.875643 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ec2add48-428d-4522-bc43-d9a4e62f896f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:37.876122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ec2add48-428d-4522-bc43-d9a4e62f896f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:37.876813 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ec2add48-428d-4522-bc43-d9a4e62f896f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:37.984092 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-ea319ec5-4d8c-4aee-a571-0bddf61f17ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:37.984729 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-ea319ec5-4d8c-4aee-a571-0bddf61f17ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:38.010965 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ea319ec5-4d8c-4aee-a571-0bddf61f17ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:38.011522 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ea319ec5-4d8c-4aee-a571-0bddf61f17ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:38.012562 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ea319ec5-4d8c-4aee-a571-0bddf61f17ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:38.018080 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ea319ec5-4d8c-4aee-a571-0bddf61f17ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:38.018564 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ea319ec5-4d8c-4aee-a571-0bddf61f17ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:38.023684 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ea319ec5-4d8c-4aee-a571-0bddf61f17ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:38.297909 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ec2add48-428d-4522-bc43-d9a4e62f896f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:38.314864 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-ec2add48-428d-4522-bc43-d9a4e62f896f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1516 microversion: 2.1 time: 0.491798 Oct 28 19:08:38.315508 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ea319ec5-4d8c-4aee-a571-0bddf61f17ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:38.319406 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 176/372] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:37 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1516 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:38.330448 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ea319ec5-4d8c-4aee-a571-0bddf61f17ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:38.332379 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ea319ec5-4d8c-4aee-a571-0bddf61f17ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:38.334788 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-ea319ec5-4d8c-4aee-a571-0bddf61f17ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1752 microversion: 2.20 time: 0.355343 Oct 28 19:08:38.335844 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 197/373] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:37 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1752 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:38.634053 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-f7431c25-58c3-4f6a-9587-ead163d5f244 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:38.635503 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-f7431c25-58c3-4f6a-9587-ead163d5f244 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:38.661415 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f7431c25-58c3-4f6a-9587-ead163d5f244 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:38.661907 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f7431c25-58c3-4f6a-9587-ead163d5f244 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:38.667706 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f7431c25-58c3-4f6a-9587-ead163d5f244 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:38.667706 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f7431c25-58c3-4f6a-9587-ead163d5f244 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:38.667706 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f7431c25-58c3-4f6a-9587-ead163d5f244 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:38.667706 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f7431c25-58c3-4f6a-9587-ead163d5f244 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:38.812774 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-f7431c25-58c3-4f6a-9587-ead163d5f244 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:38.826526 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-f7431c25-58c3-4f6a-9587-ead163d5f244 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1274 microversion: 2.1 time: 0.196321 Oct 28 19:08:38.827540 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 177/374] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:38 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1274 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:39.310892 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-d5d908a2-1905-47a0-9654-79b1f3d83a88 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-446938584"}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:39.311877 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-d5d908a2-1905-47a0-9654-79b1f3d83a88 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:39.318057 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d5d908a2-1905-47a0-9654-79b1f3d83a88 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:39.318554 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d5d908a2-1905-47a0-9654-79b1f3d83a88 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:39.318974 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d5d908a2-1905-47a0-9654-79b1f3d83a88 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:39.319696 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d5d908a2-1905-47a0-9654-79b1f3d83a88 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:39.320150 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d5d908a2-1905-47a0-9654-79b1f3d83a88 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:39.320573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d5d908a2-1905-47a0-9654-79b1f3d83a88 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:39.365731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-47a74e35-b734-4edc-8645-bdc911e5faf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:39.367320 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-47a74e35-b734-4edc-8645-bdc911e5faf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:39.374441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-47a74e35-b734-4edc-8645-bdc911e5faf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:39.374933 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-47a74e35-b734-4edc-8645-bdc911e5faf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:39.375405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-47a74e35-b734-4edc-8645-bdc911e5faf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:39.376564 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-47a74e35-b734-4edc-8645-bdc911e5faf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:39.377218 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-47a74e35-b734-4edc-8645-bdc911e5faf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:39.377653 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-47a74e35-b734-4edc-8645-bdc911e5faf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:39.479444 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.network.security_group_api [None req-d5d908a2-1905-47a0-9654-79b1f3d83a88 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Adding security group a7503446-424f-49ce-a1b5-fca931425411 to port 6c0693d1-2c4b-4d7e-952e-42bbac4297f8 Oct 28 19:08:39.827013 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-47a74e35-b734-4edc-8645-bdc911e5faf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:39.836571 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-47a74e35-b734-4edc-8645-bdc911e5faf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:39.838026 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-47a74e35-b734-4edc-8645-bdc911e5faf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:39.839343 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-47a74e35-b734-4edc-8645-bdc911e5faf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1752 microversion: 2.20 time: 0.477825 Oct 28 19:08:39.840542 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 178/375] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:39 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1752 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:39.860852 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-f36f6a2a-b59c-454a-a0cd-5051f4de7e32 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Action: 'create', calling method: .version_select at 0x7f9bf66b9f70>, body: {"keypair": {"name": "tempest-keypair-1906400234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBi+OeuFLYSBz8lzRa3QhTGnTK5ZDMFRkSuEzi9pqXX/YBV/MfSJz05EqFP9aa/R4kJSPX/FwgxgN1wKUIJB7APOhiIe97PfiSbZM+iHdnO1gnwoFENHfl6vIeOYtr1Fgg=="}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:39.881014 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-f36f6a2a-b59c-454a-a0cd-5051f4de7e32 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Getting quotas for project 4f6c133d9594455182ac1b9ce13df65c. Resources: {'key_pairs'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:08:39.885058 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-f36f6a2a-b59c-454a-a0cd-5051f4de7e32 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Getting quotas for user c8ca34fc5c5743d0b5e3f4f97ae285e0 and project 4f6c133d9594455182ac1b9ce13df65c. Resources: {'key_pairs'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:08:39.909848 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-f36f6a2a-b59c-454a-a0cd-5051f4de7e32 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052669 Oct 28 19:08:39.911131 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 179/376] 10.222.0.58 () {60 vars in 1159 bytes} [Fri Oct 28 19:08:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:39.919334 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-3f392be5-a1bf-4cea-bad0-61aad727e32f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:39.920121 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-3f392be5-a1bf-4cea-bad0-61aad727e32f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:39.926386 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3f392be5-a1bf-4cea-bad0-61aad727e32f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:39.926873 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3f392be5-a1bf-4cea-bad0-61aad727e32f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:39.927360 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3f392be5-a1bf-4cea-bad0-61aad727e32f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:39.928274 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3f392be5-a1bf-4cea-bad0-61aad727e32f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:39.928734 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3f392be5-a1bf-4cea-bad0-61aad727e32f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:39.929296 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3f392be5-a1bf-4cea-bad0-61aad727e32f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:40.212563 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3f392be5-a1bf-4cea-bad0-61aad727e32f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:40.221032 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-3f392be5-a1bf-4cea-bad0-61aad727e32f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1314 microversion: 2.1 time: 0.308470 Oct 28 19:08:40.221597 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 180/377] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:39 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:40.251087 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-d5d908a2-1905-47a0-9654-79b1f3d83a88 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "POST /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c/action" status: 202 len: 0 microversion: 2.1 time: 0.944305 Oct 28 19:08:40.252227 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 198/378] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Oct 28 19:08:39 2022] POST /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c/action => generated 0 bytes in 946 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:08:40.268647 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-f4fb0274-32df-4cf3-907c-fc3557b96846 req-3d7bd967-7f0e-4819-85f6-6f1259095da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be43ea5-02f7-43db-8ac7-df770da3592c", "tag": "6c0693d1-2c4b-4d7e-952e-42bbac4297f8"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:40.275337 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-375ca427-7a94-4cd1-8533-489922bff4ee tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:40.284114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-375ca427-7a94-4cd1-8533-489922bff4ee tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:40.306775 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-f4fb0274-32df-4cf3-907c-fc3557b96846 req-3d7bd967-7f0e-4819-85f6-6f1259095da5 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:40.313008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-375ca427-7a94-4cd1-8533-489922bff4ee tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:40.314132 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-375ca427-7a94-4cd1-8533-489922bff4ee tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:40.314914 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-f4fb0274-32df-4cf3-907c-fc3557b96846 req-3d7bd967-7f0e-4819-85f6-6f1259095da5 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:40.315573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-375ca427-7a94-4cd1-8533-489922bff4ee tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:40.316376 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-f4fb0274-32df-4cf3-907c-fc3557b96846 req-3d7bd967-7f0e-4819-85f6-6f1259095da5 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:40.318393 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-375ca427-7a94-4cd1-8533-489922bff4ee tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:40.318868 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-375ca427-7a94-4cd1-8533-489922bff4ee tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:40.319338 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-375ca427-7a94-4cd1-8533-489922bff4ee tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:40.362008 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-f4fb0274-32df-4cf3-907c-fc3557b96846 req-3d7bd967-7f0e-4819-85f6-6f1259095da5 service nova] Creating event network-changed:6c0693d1-2c4b-4d7e-952e-42bbac4297f8 for instance 6be43ea5-02f7-43db-8ac7-df770da3592c on hv-cinder-86236 Oct 28 19:08:40.374460 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-f4fb0274-32df-4cf3-907c-fc3557b96846 req-3d7bd967-7f0e-4819-85f6-6f1259095da5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118919 Oct 28 19:08:40.375203 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 181/379] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:08:40.430917 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-5e472d61-0ea7-4538-aa7e-9b83d1d6638e req-ee083acf-74f6-4522-aa8d-6d6dd5ce14ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41cb05e8-8ade-4928-b7c1-da54775e7a17", "tag": "9efbcaf2-ba96-40ed-a555-d555ac985dc7"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:40.450257 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-5e472d61-0ea7-4538-aa7e-9b83d1d6638e req-ee083acf-74f6-4522-aa8d-6d6dd5ce14ae service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:40.451013 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-5e472d61-0ea7-4538-aa7e-9b83d1d6638e req-ee083acf-74f6-4522-aa8d-6d6dd5ce14ae service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:40.451482 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-5e472d61-0ea7-4538-aa7e-9b83d1d6638e req-ee083acf-74f6-4522-aa8d-6d6dd5ce14ae service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:40.468341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-5e472d61-0ea7-4538-aa7e-9b83d1d6638e req-ee083acf-74f6-4522-aa8d-6d6dd5ce14ae service nova] Creating event network-changed:9efbcaf2-ba96-40ed-a555-d555ac985dc7 for instance 41cb05e8-8ade-4928-b7c1-da54775e7a17 on hv-cinder-86236 Oct 28 19:08:40.473930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-5e472d61-0ea7-4538-aa7e-9b83d1d6638e req-ee083acf-74f6-4522-aa8d-6d6dd5ce14ae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047231 Oct 28 19:08:40.474609 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 182/380] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:08:40.620257 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-375ca427-7a94-4cd1-8533-489922bff4ee tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:40.630079 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-375ca427-7a94-4cd1-8533-489922bff4ee tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1757 microversion: 2.1 time: 0.366443 Oct 28 19:08:40.630648 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 199/381] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:40 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1757 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:40.874955 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-2d3bd85b-c770-488f-93dc-2429d007c849 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:40.875624 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-2d3bd85b-c770-488f-93dc-2429d007c849 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:40.887873 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2d3bd85b-c770-488f-93dc-2429d007c849 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:40.888476 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2d3bd85b-c770-488f-93dc-2429d007c849 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:40.888992 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2d3bd85b-c770-488f-93dc-2429d007c849 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:40.889919 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2d3bd85b-c770-488f-93dc-2429d007c849 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:40.890382 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2d3bd85b-c770-488f-93dc-2429d007c849 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:40.890970 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2d3bd85b-c770-488f-93dc-2429d007c849 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:41.068553 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2d3bd85b-c770-488f-93dc-2429d007c849 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:41.085889 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2d3bd85b-c770-488f-93dc-2429d007c849 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:41.088022 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2d3bd85b-c770-488f-93dc-2429d007c849 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:41.089552 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-2d3bd85b-c770-488f-93dc-2429d007c849 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1752 microversion: 2.20 time: 0.219719 Oct 28 19:08:41.090865 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 183/382] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:40 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1752 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:41.243909 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-753c854a-ea32-4360-b9b8-07964c716531 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:41.244504 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-753c854a-ea32-4360-b9b8-07964c716531 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:41.250443 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-753c854a-ea32-4360-b9b8-07964c716531 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:41.250951 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-753c854a-ea32-4360-b9b8-07964c716531 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:41.251385 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-753c854a-ea32-4360-b9b8-07964c716531 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:41.252068 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-753c854a-ea32-4360-b9b8-07964c716531 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:41.252516 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-753c854a-ea32-4360-b9b8-07964c716531 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:41.252934 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-753c854a-ea32-4360-b9b8-07964c716531 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:41.385270 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-753c854a-ea32-4360-b9b8-07964c716531 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:41.394559 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-753c854a-ea32-4360-b9b8-07964c716531 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1314 microversion: 2.1 time: 0.154405 Oct 28 19:08:41.395627 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 200/383] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:41 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:42.117154 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-00a4a07b-6367-4f12-a5a0-8465b8c78725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:42.117775 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-00a4a07b-6367-4f12-a5a0-8465b8c78725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:42.128103 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-00a4a07b-6367-4f12-a5a0-8465b8c78725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.128607 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-00a4a07b-6367-4f12-a5a0-8465b8c78725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.129066 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-00a4a07b-6367-4f12-a5a0-8465b8c78725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.130535 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-00a4a07b-6367-4f12-a5a0-8465b8c78725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.131045 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-00a4a07b-6367-4f12-a5a0-8465b8c78725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.132042 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-00a4a07b-6367-4f12-a5a0-8465b8c78725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.307205 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-00a4a07b-6367-4f12-a5a0-8465b8c78725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:42.325501 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-00a4a07b-6367-4f12-a5a0-8465b8c78725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:42.327224 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-00a4a07b-6367-4f12-a5a0-8465b8c78725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:42.328574 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-00a4a07b-6367-4f12-a5a0-8465b8c78725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1752 microversion: 2.20 time: 0.216775 Oct 28 19:08:42.329582 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 184/384] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:42 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1752 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:42.400729 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-35ef0810-8c93-4e5f-99b3-fbee934df8cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:42.407292 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-35ef0810-8c93-4e5f-99b3-fbee934df8cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.407700 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-35ef0810-8c93-4e5f-99b3-fbee934df8cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.408144 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-35ef0810-8c93-4e5f-99b3-fbee934df8cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.429348 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-949ff567-de7e-44dc-883c-fd086d90a9af tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:42.430332 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-949ff567-de7e-44dc-883c-fd086d90a9af tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:42.443285 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-949ff567-de7e-44dc-883c-fd086d90a9af tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.444281 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-949ff567-de7e-44dc-883c-fd086d90a9af tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.446056 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-949ff567-de7e-44dc-883c-fd086d90a9af tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.447248 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-949ff567-de7e-44dc-883c-fd086d90a9af tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.448170 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-949ff567-de7e-44dc-883c-fd086d90a9af tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.458008 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-949ff567-de7e-44dc-883c-fd086d90a9af tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.510175 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-35ef0810-8c93-4e5f-99b3-fbee934df8cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Going to try to stop instance {{(pid=118874) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 19:08:42.614085 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-35ef0810-8c93-4e5f-99b3-fbee934df8cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "POST /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/action" status: 202 len: 0 microversion: 2.1 time: 0.217279 Oct 28 19:08:42.615373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 201/385] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Oct 28 19:08:42 2022] POST /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:08:42.624753 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-77ced211-5594-4b35-ad09-cd7c0b27c1f3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:42.627356 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-77ced211-5594-4b35-ad09-cd7c0b27c1f3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:42.641834 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-77ced211-5594-4b35-ad09-cd7c0b27c1f3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.642420 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-77ced211-5594-4b35-ad09-cd7c0b27c1f3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.642870 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-77ced211-5594-4b35-ad09-cd7c0b27c1f3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.643831 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-77ced211-5594-4b35-ad09-cd7c0b27c1f3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.644505 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-77ced211-5594-4b35-ad09-cd7c0b27c1f3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.645428 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-77ced211-5594-4b35-ad09-cd7c0b27c1f3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.685453 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-949ff567-de7e-44dc-883c-fd086d90a9af tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:42.693423 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-949ff567-de7e-44dc-883c-fd086d90a9af tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1314 microversion: 2.1 time: 0.271598 Oct 28 19:08:42.693990 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 185/386] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:42 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:42.706816 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-1dae7f01-f3db-4135-95f1-13def1be3529 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1230236342", "imageRef": "cd92a575-ed0d-417b-b416-3471be3ba100", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c885fca-8f30-433d-8742-508f4f0d3d38"}], "security_groups": [{"name": "tempest-securitygroup--2066667609"}], "key_name": "tempest-keypair-1906400234", "user_data": "}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:42.833286 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-77ced211-5594-4b35-ad09-cd7c0b27c1f3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:42.836794 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:42.839315 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.network.neutron [None req-1dae7f01-f3db-4135-95f1-13def1be3529 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] validate_networks() for [('9c885fca-8f30-433d-8742-508f4f0d3d38', None, None, None, None, None)] {{(pid=118875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:08:42.842929 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-77ced211-5594-4b35-ad09-cd7c0b27c1f3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1724 microversion: 2.1 time: 0.222433 Oct 28 19:08:42.843532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 202/387] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:42 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:43.222930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-1dae7f01-f3db-4135-95f1-13def1be3529 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Flavor limits 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:08:43.223456 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-1dae7f01-f3db-4135-95f1-13def1be3529 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Image limits 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:08:43.223893 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-1dae7f01-f3db-4135-95f1-13def1be3529 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Flavor pref 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:08:43.224311 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-1dae7f01-f3db-4135-95f1-13def1be3529 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Image pref 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:08:43.224808 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-1dae7f01-f3db-4135-95f1-13def1be3529 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:08:43.234889 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1dae7f01-f3db-4135-95f1-13def1be3529 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:43.235407 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1dae7f01-f3db-4135-95f1-13def1be3529 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:43.235883 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1dae7f01-f3db-4135-95f1-13def1be3529 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:43.236615 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1dae7f01-f3db-4135-95f1-13def1be3529 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:43.237070 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1dae7f01-f3db-4135-95f1-13def1be3529 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:43.237502 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1dae7f01-f3db-4135-95f1-13def1be3529 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:43.254214 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-1dae7f01-f3db-4135-95f1-13def1be3529 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Getting quotas for project 4f6c133d9594455182ac1b9ce13df65c. Resources: {'ram', 'instances', 'cores'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:08:43.258135 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-1dae7f01-f3db-4135-95f1-13def1be3529 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Getting quotas for user c8ca34fc5c5743d0b5e3f4f97ae285e0 and project 4f6c133d9594455182ac1b9ce13df65c. Resources: {'ram', 'instances', 'cores'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:08:43.270162 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-1dae7f01-f3db-4135-95f1-13def1be3529 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Going to run 1 instances... {{(pid=118875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:08:43.272561 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-1dae7f01-f3db-4135-95f1-13def1be3529 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd92a575-ed0d-417b-b416-3471be3ba100',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:08:43.291689 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:43.317993 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-1dae7f01-f3db-4135-95f1-13def1be3529 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.615781 Oct 28 19:08:43.318644 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 186/388] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Oct 28 19:08:42 2022] POST /compute/v2.1/servers => generated 409 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:08:43.330349 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1e26e275-805a-48f1-ac04-ba8958a1e256 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:43.331184 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-1e26e275-805a-48f1-ac04-ba8958a1e256 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:43.355984 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d3cef3fa-9904-47d0-ab69-60aaa8df3134 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:43.356701 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d3cef3fa-9904-47d0-ab69-60aaa8df3134 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:43.363659 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d3cef3fa-9904-47d0-ab69-60aaa8df3134 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:43.364223 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d3cef3fa-9904-47d0-ab69-60aaa8df3134 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:43.364738 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d3cef3fa-9904-47d0-ab69-60aaa8df3134 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:43.365616 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d3cef3fa-9904-47d0-ab69-60aaa8df3134 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:43.366233 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d3cef3fa-9904-47d0-ab69-60aaa8df3134 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:43.366824 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d3cef3fa-9904-47d0-ab69-60aaa8df3134 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:43.389955 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-1e26e275-805a-48f1-ac04-ba8958a1e256 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:43.397226 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-1e26e275-805a-48f1-ac04-ba8958a1e256 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1246 microversion: 2.1 time: 0.070640 Oct 28 19:08:43.399609 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 203/389] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:43 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1246 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:43.500806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d3cef3fa-9904-47d0-ab69-60aaa8df3134 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:43.504202 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=100 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:43.510304 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d3cef3fa-9904-47d0-ab69-60aaa8df3134 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:43.512631 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d3cef3fa-9904-47d0-ab69-60aaa8df3134 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:43.513742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d3cef3fa-9904-47d0-ab69-60aaa8df3134 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.162381 Oct 28 19:08:43.514391 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 187/390] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:43 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:43.718185 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-01b9bde0-4adb-4bf4-bd0f-3040bef3f3a0 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:43.718827 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-01b9bde0-4adb-4bf4-bd0f-3040bef3f3a0 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:43.725002 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-01b9bde0-4adb-4bf4-bd0f-3040bef3f3a0 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:43.725428 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-01b9bde0-4adb-4bf4-bd0f-3040bef3f3a0 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:43.725928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-01b9bde0-4adb-4bf4-bd0f-3040bef3f3a0 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:43.726615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-01b9bde0-4adb-4bf4-bd0f-3040bef3f3a0 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:43.727111 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-01b9bde0-4adb-4bf4-bd0f-3040bef3f3a0 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:43.727542 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-01b9bde0-4adb-4bf4-bd0f-3040bef3f3a0 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:43.856584 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-01b9bde0-4adb-4bf4-bd0f-3040bef3f3a0 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:43.864223 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-01b9bde0-4adb-4bf4-bd0f-3040bef3f3a0 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1314 microversion: 2.1 time: 0.150698 Oct 28 19:08:43.864785 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 204/391] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:43 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:43.866051 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-dd66a95d-2f90-4859-8fc6-2e7a9895d4f4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:43.866671 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-dd66a95d-2f90-4859-8fc6-2e7a9895d4f4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:43.873389 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-dd66a95d-2f90-4859-8fc6-2e7a9895d4f4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:43.873877 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-dd66a95d-2f90-4859-8fc6-2e7a9895d4f4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:43.874322 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-dd66a95d-2f90-4859-8fc6-2e7a9895d4f4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:43.875043 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-dd66a95d-2f90-4859-8fc6-2e7a9895d4f4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:43.875508 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-dd66a95d-2f90-4859-8fc6-2e7a9895d4f4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:43.875938 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-dd66a95d-2f90-4859-8fc6-2e7a9895d4f4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:44.001494 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-dd66a95d-2f90-4859-8fc6-2e7a9895d4f4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:44.009706 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-dd66a95d-2f90-4859-8fc6-2e7a9895d4f4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1724 microversion: 2.1 time: 0.147614 Oct 28 19:08:44.010273 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 188/392] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:43 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:44.421736 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-fac083ee-eb42-422c-a1b0-6d7cb77b2683 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:44.422331 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-fac083ee-eb42-422c-a1b0-6d7cb77b2683 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:44.428458 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fac083ee-eb42-422c-a1b0-6d7cb77b2683 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:44.428924 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fac083ee-eb42-422c-a1b0-6d7cb77b2683 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:44.429351 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fac083ee-eb42-422c-a1b0-6d7cb77b2683 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:44.430028 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fac083ee-eb42-422c-a1b0-6d7cb77b2683 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:44.430473 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fac083ee-eb42-422c-a1b0-6d7cb77b2683 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:44.430892 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fac083ee-eb42-422c-a1b0-6d7cb77b2683 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:44.491315 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-fac083ee-eb42-422c-a1b0-6d7cb77b2683 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:44.499914 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-fac083ee-eb42-422c-a1b0-6d7cb77b2683 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1242 microversion: 2.1 time: 0.082047 Oct 28 19:08:44.500479 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 205/393] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:44 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:44.540968 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-666e0a01-33e2-4761-a8d0-2b028cde508d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:44.541567 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-666e0a01-33e2-4761-a8d0-2b028cde508d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:44.548066 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-666e0a01-33e2-4761-a8d0-2b028cde508d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:44.548550 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-666e0a01-33e2-4761-a8d0-2b028cde508d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:44.548983 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-666e0a01-33e2-4761-a8d0-2b028cde508d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:44.549673 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-666e0a01-33e2-4761-a8d0-2b028cde508d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:44.550124 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-666e0a01-33e2-4761-a8d0-2b028cde508d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:44.550548 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-666e0a01-33e2-4761-a8d0-2b028cde508d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:44.691159 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-666e0a01-33e2-4761-a8d0-2b028cde508d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:44.700443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-666e0a01-33e2-4761-a8d0-2b028cde508d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:44.701903 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-666e0a01-33e2-4761-a8d0-2b028cde508d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:44.703108 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-666e0a01-33e2-4761-a8d0-2b028cde508d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.165940 Oct 28 19:08:44.703678 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 189/394] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:44 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:44.887865 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-e1cf00e7-6a5f-446c-b7ea-438e6ee0fec2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:44.888527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-e1cf00e7-6a5f-446c-b7ea-438e6ee0fec2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:44.894891 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e1cf00e7-6a5f-446c-b7ea-438e6ee0fec2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:44.895636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e1cf00e7-6a5f-446c-b7ea-438e6ee0fec2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:44.896136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e1cf00e7-6a5f-446c-b7ea-438e6ee0fec2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:44.896899 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e1cf00e7-6a5f-446c-b7ea-438e6ee0fec2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:44.897407 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e1cf00e7-6a5f-446c-b7ea-438e6ee0fec2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:44.898034 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e1cf00e7-6a5f-446c-b7ea-438e6ee0fec2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.031721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e1cf00e7-6a5f-446c-b7ea-438e6ee0fec2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:45.034094 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-375bc8bf-7084-4565-9460-9d8eca2c5eb0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:45.034701 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-375bc8bf-7084-4565-9460-9d8eca2c5eb0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:45.039599 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-e1cf00e7-6a5f-446c-b7ea-438e6ee0fec2 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1314 microversion: 2.1 time: 0.156088 Oct 28 19:08:45.040192 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 206/395] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:44 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:45.040659 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-375bc8bf-7084-4565-9460-9d8eca2c5eb0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:45.041150 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-375bc8bf-7084-4565-9460-9d8eca2c5eb0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:45.041596 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-375bc8bf-7084-4565-9460-9d8eca2c5eb0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.042295 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-375bc8bf-7084-4565-9460-9d8eca2c5eb0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:45.042789 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-375bc8bf-7084-4565-9460-9d8eca2c5eb0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:45.043251 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-375bc8bf-7084-4565-9460-9d8eca2c5eb0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.172890 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-375bc8bf-7084-4565-9460-9d8eca2c5eb0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:45.181033 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-375bc8bf-7084-4565-9460-9d8eca2c5eb0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1724 microversion: 2.1 time: 0.150715 Oct 28 19:08:45.181585 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 190/396] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:45 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:45.523792 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-af963fd4-f4ab-4119-b0be-0fcb174906a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:45.524552 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-af963fd4-f4ab-4119-b0be-0fcb174906a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:45.531026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-af963fd4-f4ab-4119-b0be-0fcb174906a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:45.531737 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-af963fd4-f4ab-4119-b0be-0fcb174906a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:45.532171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-af963fd4-f4ab-4119-b0be-0fcb174906a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.532857 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-af963fd4-f4ab-4119-b0be-0fcb174906a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:45.533498 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-af963fd4-f4ab-4119-b0be-0fcb174906a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:45.533928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-af963fd4-f4ab-4119-b0be-0fcb174906a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.598556 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-af963fd4-f4ab-4119-b0be-0fcb174906a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:45.606733 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-af963fd4-f4ab-4119-b0be-0fcb174906a0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1304 microversion: 2.1 time: 0.087100 Oct 28 19:08:45.607329 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 207/397] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:45 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1304 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:45.727783 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-643c2fb8-f129-4bc3-a93a-95f68e26315a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:45.728629 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-643c2fb8-f129-4bc3-a93a-95f68e26315a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:45.736018 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-643c2fb8-f129-4bc3-a93a-95f68e26315a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:45.736521 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-643c2fb8-f129-4bc3-a93a-95f68e26315a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:45.740015 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-643c2fb8-f129-4bc3-a93a-95f68e26315a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.740805 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-643c2fb8-f129-4bc3-a93a-95f68e26315a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:45.741284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-643c2fb8-f129-4bc3-a93a-95f68e26315a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:45.741709 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-643c2fb8-f129-4bc3-a93a-95f68e26315a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.882273 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-643c2fb8-f129-4bc3-a93a-95f68e26315a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:45.892316 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-643c2fb8-f129-4bc3-a93a-95f68e26315a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:45.893922 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-643c2fb8-f129-4bc3-a93a-95f68e26315a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:45.895507 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-643c2fb8-f129-4bc3-a93a-95f68e26315a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.171831 Oct 28 19:08:45.896066 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 191/398] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:45 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:46.062541 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-84b3f3a2-a770-4458-a3b7-69f2a764edfa tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:46.063180 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-84b3f3a2-a770-4458-a3b7-69f2a764edfa tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:46.070174 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-84b3f3a2-a770-4458-a3b7-69f2a764edfa tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:46.070670 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-84b3f3a2-a770-4458-a3b7-69f2a764edfa tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:46.071143 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-84b3f3a2-a770-4458-a3b7-69f2a764edfa tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:46.071956 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-84b3f3a2-a770-4458-a3b7-69f2a764edfa tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:46.072417 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-84b3f3a2-a770-4458-a3b7-69f2a764edfa tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:46.072940 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-84b3f3a2-a770-4458-a3b7-69f2a764edfa tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:46.206424 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-124b5226-8f7d-42c5-96e6-e628cac7b884 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:46.207183 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-124b5226-8f7d-42c5-96e6-e628cac7b884 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:46.216123 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-124b5226-8f7d-42c5-96e6-e628cac7b884 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:46.216913 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-124b5226-8f7d-42c5-96e6-e628cac7b884 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:46.217527 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-124b5226-8f7d-42c5-96e6-e628cac7b884 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:46.218243 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-124b5226-8f7d-42c5-96e6-e628cac7b884 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:46.218952 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-124b5226-8f7d-42c5-96e6-e628cac7b884 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:46.219800 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-124b5226-8f7d-42c5-96e6-e628cac7b884 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:46.228343 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-84b3f3a2-a770-4458-a3b7-69f2a764edfa tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:46.251876 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-84b3f3a2-a770-4458-a3b7-69f2a764edfa tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1314 microversion: 2.1 time: 0.192880 Oct 28 19:08:46.253227 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 208/399] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:46 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:46.412107 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-124b5226-8f7d-42c5-96e6-e628cac7b884 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:46.425193 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-124b5226-8f7d-42c5-96e6-e628cac7b884 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1724 microversion: 2.1 time: 0.225005 Oct 28 19:08:46.426195 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 192/400] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:46 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:46.630910 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-e62b452b-2440-4ad7-ba02-233901fdc243 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:46.632077 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-e62b452b-2440-4ad7-ba02-233901fdc243 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:46.640524 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e62b452b-2440-4ad7-ba02-233901fdc243 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:46.641636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e62b452b-2440-4ad7-ba02-233901fdc243 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:46.642314 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e62b452b-2440-4ad7-ba02-233901fdc243 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:46.643288 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e62b452b-2440-4ad7-ba02-233901fdc243 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:46.643965 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e62b452b-2440-4ad7-ba02-233901fdc243 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:46.644605 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e62b452b-2440-4ad7-ba02-233901fdc243 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:46.871749 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e62b452b-2440-4ad7-ba02-233901fdc243 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:46.884847 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-e62b452b-2440-4ad7-ba02-233901fdc243 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1372 microversion: 2.1 time: 0.258248 Oct 28 19:08:46.886122 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 209/401] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:46 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1372 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:46.923202 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-41847cf4-ab39-4e62-b76a-f261f2cfb9eb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:46.923919 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-41847cf4-ab39-4e62-b76a-f261f2cfb9eb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:46.932833 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-41847cf4-ab39-4e62-b76a-f261f2cfb9eb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:46.933990 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-41847cf4-ab39-4e62-b76a-f261f2cfb9eb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:46.934664 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-41847cf4-ab39-4e62-b76a-f261f2cfb9eb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:46.935799 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-41847cf4-ab39-4e62-b76a-f261f2cfb9eb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:46.936602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-41847cf4-ab39-4e62-b76a-f261f2cfb9eb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:46.937375 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-41847cf4-ab39-4e62-b76a-f261f2cfb9eb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:47.131471 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-41847cf4-ab39-4e62-b76a-f261f2cfb9eb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:47.142375 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-41847cf4-ab39-4e62-b76a-f261f2cfb9eb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:47.144000 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-41847cf4-ab39-4e62-b76a-f261f2cfb9eb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:47.145354 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-41847cf4-ab39-4e62-b76a-f261f2cfb9eb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.227634 Oct 28 19:08:47.146391 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 193/402] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:46 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:08:47.280997 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-51e6f747-3c70-416b-9a3c-bd3b569e6696 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:47.281933 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-51e6f747-3c70-416b-9a3c-bd3b569e6696 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:47.288719 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-51e6f747-3c70-416b-9a3c-bd3b569e6696 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:47.289336 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-51e6f747-3c70-416b-9a3c-bd3b569e6696 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:47.289926 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-51e6f747-3c70-416b-9a3c-bd3b569e6696 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:47.290824 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-51e6f747-3c70-416b-9a3c-bd3b569e6696 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:47.291558 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-51e6f747-3c70-416b-9a3c-bd3b569e6696 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:47.292235 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-51e6f747-3c70-416b-9a3c-bd3b569e6696 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:47.425706 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-51e6f747-3c70-416b-9a3c-bd3b569e6696 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:47.434020 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-51e6f747-3c70-416b-9a3c-bd3b569e6696 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1314 microversion: 2.1 time: 0.156797 Oct 28 19:08:47.434588 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 210/403] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:47 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:47.450275 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d15bd9be-8db2-4559-86ed-069c6e059aed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:47.451332 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d15bd9be-8db2-4559-86ed-069c6e059aed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:47.457958 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d15bd9be-8db2-4559-86ed-069c6e059aed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:47.458532 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d15bd9be-8db2-4559-86ed-069c6e059aed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:47.459068 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d15bd9be-8db2-4559-86ed-069c6e059aed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:47.459848 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d15bd9be-8db2-4559-86ed-069c6e059aed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:47.460388 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d15bd9be-8db2-4559-86ed-069c6e059aed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:47.460915 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d15bd9be-8db2-4559-86ed-069c6e059aed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:47.602785 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d15bd9be-8db2-4559-86ed-069c6e059aed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:47.612246 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d15bd9be-8db2-4559-86ed-069c6e059aed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1724 microversion: 2.1 time: 0.166116 Oct 28 19:08:47.612828 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 194/404] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:47 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:47.909603 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-bb8a1325-3ab8-417a-b1e0-d241d5e59894 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:47.910277 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-bb8a1325-3ab8-417a-b1e0-d241d5e59894 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:47.916261 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bb8a1325-3ab8-417a-b1e0-d241d5e59894 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:47.916792 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bb8a1325-3ab8-417a-b1e0-d241d5e59894 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:47.917273 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bb8a1325-3ab8-417a-b1e0-d241d5e59894 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:47.918510 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bb8a1325-3ab8-417a-b1e0-d241d5e59894 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:47.918955 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bb8a1325-3ab8-417a-b1e0-d241d5e59894 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:47.919461 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-bb8a1325-3ab8-417a-b1e0-d241d5e59894 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:48.054876 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-bb8a1325-3ab8-417a-b1e0-d241d5e59894 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:48.064326 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-bb8a1325-3ab8-417a-b1e0-d241d5e59894 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1372 microversion: 2.1 time: 0.158538 Oct 28 19:08:48.065133 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 211/405] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:47 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:48.172374 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-9a4f5e37-25a2-4ada-a5ea-36aae1a91549 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:48.173071 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-9a4f5e37-25a2-4ada-a5ea-36aae1a91549 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:48.179933 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9a4f5e37-25a2-4ada-a5ea-36aae1a91549 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:48.180428 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9a4f5e37-25a2-4ada-a5ea-36aae1a91549 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:48.180878 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9a4f5e37-25a2-4ada-a5ea-36aae1a91549 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:48.181590 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9a4f5e37-25a2-4ada-a5ea-36aae1a91549 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:48.182051 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9a4f5e37-25a2-4ada-a5ea-36aae1a91549 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:48.182481 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9a4f5e37-25a2-4ada-a5ea-36aae1a91549 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:48.341562 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-9a4f5e37-25a2-4ada-a5ea-36aae1a91549 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:48.352918 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-9a4f5e37-25a2-4ada-a5ea-36aae1a91549 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:48.354645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-9a4f5e37-25a2-4ada-a5ea-36aae1a91549 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:48.356599 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-9a4f5e37-25a2-4ada-a5ea-36aae1a91549 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.188900 Oct 28 19:08:48.357437 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 195/406] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:48 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:48.457458 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-256d570f-54ba-4291-b478-6689d24dea21 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:48.458162 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-febce5e0-2f11-42d5-90aa-4fd292f67f8d req-e8043f34-8c4f-46a8-9fae-c000a88eb376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41cb05e8-8ade-4928-b7c1-da54775e7a17", "name": "network-vif-plugged", "status": "completed", "tag": "9efbcaf2-ba96-40ed-a555-d555ac985dc7"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:48.458293 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-256d570f-54ba-4291-b478-6689d24dea21 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:48.465166 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-256d570f-54ba-4291-b478-6689d24dea21 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:48.465550 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-256d570f-54ba-4291-b478-6689d24dea21 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:48.465969 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-256d570f-54ba-4291-b478-6689d24dea21 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:48.466678 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-256d570f-54ba-4291-b478-6689d24dea21 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:48.467168 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-256d570f-54ba-4291-b478-6689d24dea21 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:48.471719 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-febce5e0-2f11-42d5-90aa-4fd292f67f8d req-e8043f34-8c4f-46a8-9fae-c000a88eb376 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:48.472432 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-febce5e0-2f11-42d5-90aa-4fd292f67f8d req-e8043f34-8c4f-46a8-9fae-c000a88eb376 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:48.473165 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-febce5e0-2f11-42d5-90aa-4fd292f67f8d req-e8043f34-8c4f-46a8-9fae-c000a88eb376 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:48.476570 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-256d570f-54ba-4291-b478-6689d24dea21 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:48.486839 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-febce5e0-2f11-42d5-90aa-4fd292f67f8d req-e8043f34-8c4f-46a8-9fae-c000a88eb376 service nova] Creating event network-vif-plugged:9efbcaf2-ba96-40ed-a555-d555ac985dc7 for instance 41cb05e8-8ade-4928-b7c1-da54775e7a17 on hv-cinder-86236 Oct 28 19:08:48.493471 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-febce5e0-2f11-42d5-90aa-4fd292f67f8d req-e8043f34-8c4f-46a8-9fae-c000a88eb376 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038710 Oct 28 19:08:48.494394 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 196/407] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:08:48.633099 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-256d570f-54ba-4291-b478-6689d24dea21 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:48.637999 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-00184c39-c122-4fec-a912-0b2960318e72 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:48.638701 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-00184c39-c122-4fec-a912-0b2960318e72 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:48.642200 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-256d570f-54ba-4291-b478-6689d24dea21 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1314 microversion: 2.1 time: 0.188744 Oct 28 19:08:48.642915 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 212/408] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:48 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:48.645623 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-00184c39-c122-4fec-a912-0b2960318e72 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:48.646335 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-00184c39-c122-4fec-a912-0b2960318e72 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:48.646919 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-00184c39-c122-4fec-a912-0b2960318e72 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:48.647647 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-00184c39-c122-4fec-a912-0b2960318e72 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:48.648130 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-00184c39-c122-4fec-a912-0b2960318e72 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:48.648580 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-00184c39-c122-4fec-a912-0b2960318e72 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:48.810494 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-00184c39-c122-4fec-a912-0b2960318e72 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:48.819474 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-00184c39-c122-4fec-a912-0b2960318e72 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1724 microversion: 2.1 time: 0.185966 Oct 28 19:08:48.830726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 197/409] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:48 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:49.087947 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-43b23aeb-107e-4130-9e11-067e8fb7c919 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:49.088586 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-43b23aeb-107e-4130-9e11-067e8fb7c919 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:49.095494 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-43b23aeb-107e-4130-9e11-067e8fb7c919 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.095988 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-43b23aeb-107e-4130-9e11-067e8fb7c919 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.096426 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-43b23aeb-107e-4130-9e11-067e8fb7c919 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.097163 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-43b23aeb-107e-4130-9e11-067e8fb7c919 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.097613 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-43b23aeb-107e-4130-9e11-067e8fb7c919 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.098039 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-43b23aeb-107e-4130-9e11-067e8fb7c919 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.279857 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-43b23aeb-107e-4130-9e11-067e8fb7c919 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:49.287746 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-43b23aeb-107e-4130-9e11-067e8fb7c919 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1372 microversion: 2.1 time: 0.203729 Oct 28 19:08:49.288323 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 213/410] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:49 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1372 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:49.381983 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-2674d790-ddda-48bd-9205-3fa5df540ea2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:49.382701 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-2674d790-ddda-48bd-9205-3fa5df540ea2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:49.390400 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2674d790-ddda-48bd-9205-3fa5df540ea2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.390883 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2674d790-ddda-48bd-9205-3fa5df540ea2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.391354 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2674d790-ddda-48bd-9205-3fa5df540ea2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.392049 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2674d790-ddda-48bd-9205-3fa5df540ea2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.392640 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2674d790-ddda-48bd-9205-3fa5df540ea2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.393031 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2674d790-ddda-48bd-9205-3fa5df540ea2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.530234 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2674d790-ddda-48bd-9205-3fa5df540ea2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:49.539741 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2674d790-ddda-48bd-9205-3fa5df540ea2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:49.541300 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2674d790-ddda-48bd-9205-3fa5df540ea2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:49.542631 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-2674d790-ddda-48bd-9205-3fa5df540ea2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.164591 Oct 28 19:08:49.543313 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 198/411] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:49 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:49.665659 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-8fe45f64-0914-44f0-9801-3539e0956c02 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:49.666208 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-8fe45f64-0914-44f0-9801-3539e0956c02 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:49.672277 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8fe45f64-0914-44f0-9801-3539e0956c02 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.672761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8fe45f64-0914-44f0-9801-3539e0956c02 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.673200 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8fe45f64-0914-44f0-9801-3539e0956c02 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.673903 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8fe45f64-0914-44f0-9801-3539e0956c02 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.674354 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8fe45f64-0914-44f0-9801-3539e0956c02 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.674780 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8fe45f64-0914-44f0-9801-3539e0956c02 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.815942 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-8fe45f64-0914-44f0-9801-3539e0956c02 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:49.824888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-8fe45f64-0914-44f0-9801-3539e0956c02 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1314 microversion: 2.1 time: 0.162481 Oct 28 19:08:49.825740 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 214/412] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:49 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:49.841707 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-ccdb385e-22f9-4225-990b-729c31cac5cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:49.842249 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-ccdb385e-22f9-4225-990b-729c31cac5cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:49.848596 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ccdb385e-22f9-4225-990b-729c31cac5cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.849090 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ccdb385e-22f9-4225-990b-729c31cac5cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.849535 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ccdb385e-22f9-4225-990b-729c31cac5cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.850288 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ccdb385e-22f9-4225-990b-729c31cac5cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.850745 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ccdb385e-22f9-4225-990b-729c31cac5cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.851213 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ccdb385e-22f9-4225-990b-729c31cac5cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.999942 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ccdb385e-22f9-4225-990b-729c31cac5cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:50.008468 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-ccdb385e-22f9-4225-990b-729c31cac5cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1724 microversion: 2.1 time: 0.170638 Oct 28 19:08:50.009244 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 199/413] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:49 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:50.312657 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-25b9f688-f685-447d-9e66-8dd3e677382d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:50.313255 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-25b9f688-f685-447d-9e66-8dd3e677382d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:50.319181 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-25b9f688-f685-447d-9e66-8dd3e677382d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:50.319657 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-25b9f688-f685-447d-9e66-8dd3e677382d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:50.320290 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-25b9f688-f685-447d-9e66-8dd3e677382d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:50.320981 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-25b9f688-f685-447d-9e66-8dd3e677382d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:50.321428 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-25b9f688-f685-447d-9e66-8dd3e677382d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:50.321978 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-25b9f688-f685-447d-9e66-8dd3e677382d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:50.461706 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-25b9f688-f685-447d-9e66-8dd3e677382d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:50.470537 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-25b9f688-f685-447d-9e66-8dd3e677382d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1372 microversion: 2.1 time: 0.163031 Oct 28 19:08:50.471204 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 215/414] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:50 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:50.568886 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-9019ff43-fcaf-49df-abe6-cf6c5e2192af tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:50.569546 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-9019ff43-fcaf-49df-abe6-cf6c5e2192af tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:50.576867 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9019ff43-fcaf-49df-abe6-cf6c5e2192af tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:50.577355 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9019ff43-fcaf-49df-abe6-cf6c5e2192af tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:50.577877 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9019ff43-fcaf-49df-abe6-cf6c5e2192af tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:50.578577 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9019ff43-fcaf-49df-abe6-cf6c5e2192af tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:50.579047 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9019ff43-fcaf-49df-abe6-cf6c5e2192af tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:50.579469 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9019ff43-fcaf-49df-abe6-cf6c5e2192af tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:50.723079 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-9019ff43-fcaf-49df-abe6-cf6c5e2192af tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:50.732425 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-9019ff43-fcaf-49df-abe6-cf6c5e2192af tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:50.733866 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-9019ff43-fcaf-49df-abe6-cf6c5e2192af tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:50.735083 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-9019ff43-fcaf-49df-abe6-cf6c5e2192af tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.170799 Oct 28 19:08:50.736123 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 200/415] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:50 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:08:50.848895 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-23f8a9f3-e9e6-4727-9614-a8ebf045c64f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:50.849512 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-23f8a9f3-e9e6-4727-9614-a8ebf045c64f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:50.855955 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-23f8a9f3-e9e6-4727-9614-a8ebf045c64f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:50.856440 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-23f8a9f3-e9e6-4727-9614-a8ebf045c64f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:50.856875 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-23f8a9f3-e9e6-4727-9614-a8ebf045c64f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:50.857571 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-23f8a9f3-e9e6-4727-9614-a8ebf045c64f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:50.858096 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-23f8a9f3-e9e6-4727-9614-a8ebf045c64f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:50.858529 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-23f8a9f3-e9e6-4727-9614-a8ebf045c64f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:50.998156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-23f8a9f3-e9e6-4727-9614-a8ebf045c64f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:51.006217 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-23f8a9f3-e9e6-4727-9614-a8ebf045c64f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1314 microversion: 2.1 time: 0.161301 Oct 28 19:08:51.007075 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 216/416] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:50 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:51.033928 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-088c8799-373b-4be9-be2c-ab0a33b62f53 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:51.034544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-088c8799-373b-4be9-be2c-ab0a33b62f53 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:51.041135 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-088c8799-373b-4be9-be2c-ab0a33b62f53 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.041641 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-088c8799-373b-4be9-be2c-ab0a33b62f53 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.042093 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-088c8799-373b-4be9-be2c-ab0a33b62f53 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.042842 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-088c8799-373b-4be9-be2c-ab0a33b62f53 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.043327 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-088c8799-373b-4be9-be2c-ab0a33b62f53 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.043767 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-088c8799-373b-4be9-be2c-ab0a33b62f53 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.186729 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-088c8799-373b-4be9-be2c-ab0a33b62f53 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:51.195222 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-088c8799-373b-4be9-be2c-ab0a33b62f53 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1724 microversion: 2.1 time: 0.165234 Oct 28 19:08:51.196036 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 201/417] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:51 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:51.494078 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1afe51a2-ffd3-42c6-ad9b-223a0906bc6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:51.494609 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-1afe51a2-ffd3-42c6-ad9b-223a0906bc6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:51.500795 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1afe51a2-ffd3-42c6-ad9b-223a0906bc6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.501285 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1afe51a2-ffd3-42c6-ad9b-223a0906bc6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.501729 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1afe51a2-ffd3-42c6-ad9b-223a0906bc6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.502430 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1afe51a2-ffd3-42c6-ad9b-223a0906bc6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.502884 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1afe51a2-ffd3-42c6-ad9b-223a0906bc6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.503345 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1afe51a2-ffd3-42c6-ad9b-223a0906bc6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.640248 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-1afe51a2-ffd3-42c6-ad9b-223a0906bc6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:51.647983 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-1afe51a2-ffd3-42c6-ad9b-223a0906bc6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1372 microversion: 2.1 time: 0.157932 Oct 28 19:08:51.651689 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 217/418] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:51 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:51.762513 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b7298b46-afab-41df-b75f-69714bde40c7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:51.763328 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b7298b46-afab-41df-b75f-69714bde40c7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:51.769964 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b7298b46-afab-41df-b75f-69714bde40c7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.770572 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b7298b46-afab-41df-b75f-69714bde40c7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.771140 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b7298b46-afab-41df-b75f-69714bde40c7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.771914 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b7298b46-afab-41df-b75f-69714bde40c7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.772434 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b7298b46-afab-41df-b75f-69714bde40c7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.772930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b7298b46-afab-41df-b75f-69714bde40c7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.913619 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b7298b46-afab-41df-b75f-69714bde40c7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:51.923824 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b7298b46-afab-41df-b75f-69714bde40c7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:51.925281 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b7298b46-afab-41df-b75f-69714bde40c7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:51.926467 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b7298b46-afab-41df-b75f-69714bde40c7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.169048 Oct 28 19:08:51.927579 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 202/419] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:51 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:52.030211 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-cd0f9c28-dc0c-4505-bece-5607b655cd2f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:52.030806 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-cd0f9c28-dc0c-4505-bece-5607b655cd2f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:52.036896 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cd0f9c28-dc0c-4505-bece-5607b655cd2f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.037382 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cd0f9c28-dc0c-4505-bece-5607b655cd2f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.037817 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cd0f9c28-dc0c-4505-bece-5607b655cd2f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.038509 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cd0f9c28-dc0c-4505-bece-5607b655cd2f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.038958 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cd0f9c28-dc0c-4505-bece-5607b655cd2f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.039407 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cd0f9c28-dc0c-4505-bece-5607b655cd2f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.176111 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-cd0f9c28-dc0c-4505-bece-5607b655cd2f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:52.184450 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-cd0f9c28-dc0c-4505-bece-5607b655cd2f tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1314 microversion: 2.1 time: 0.158491 Oct 28 19:08:52.185042 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 218/420] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:52 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:52.219337 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b522a24d-1bf3-409d-b857-428a88972dbb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:52.220226 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b522a24d-1bf3-409d-b857-428a88972dbb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:52.226448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b522a24d-1bf3-409d-b857-428a88972dbb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.226930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b522a24d-1bf3-409d-b857-428a88972dbb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.227414 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b522a24d-1bf3-409d-b857-428a88972dbb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.228103 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b522a24d-1bf3-409d-b857-428a88972dbb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.228551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b522a24d-1bf3-409d-b857-428a88972dbb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.228974 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b522a24d-1bf3-409d-b857-428a88972dbb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.368395 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b522a24d-1bf3-409d-b857-428a88972dbb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:52.377963 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b522a24d-1bf3-409d-b857-428a88972dbb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1724 microversion: 2.1 time: 0.162328 Oct 28 19:08:52.389339 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 203/421] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:52 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:52.672080 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-571ac215-0a39-4f96-b3e3-30e3ca7c3592 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:52.673100 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-571ac215-0a39-4f96-b3e3-30e3ca7c3592 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:52.679168 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-571ac215-0a39-4f96-b3e3-30e3ca7c3592 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.679684 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-571ac215-0a39-4f96-b3e3-30e3ca7c3592 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.680119 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-571ac215-0a39-4f96-b3e3-30e3ca7c3592 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.680811 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-571ac215-0a39-4f96-b3e3-30e3ca7c3592 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.681256 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-571ac215-0a39-4f96-b3e3-30e3ca7c3592 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.681678 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-571ac215-0a39-4f96-b3e3-30e3ca7c3592 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.823371 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-571ac215-0a39-4f96-b3e3-30e3ca7c3592 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:52.831966 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-571ac215-0a39-4f96-b3e3-30e3ca7c3592 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1372 microversion: 2.1 time: 0.163582 Oct 28 19:08:52.832554 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 219/422] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:52 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:52.952735 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c7def668-10b0-4329-b8ce-f9ca4ea0d14b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:52.953368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-c7def668-10b0-4329-b8ce-f9ca4ea0d14b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:52.960452 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c7def668-10b0-4329-b8ce-f9ca4ea0d14b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.961197 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c7def668-10b0-4329-b8ce-f9ca4ea0d14b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.961613 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c7def668-10b0-4329-b8ce-f9ca4ea0d14b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.962518 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c7def668-10b0-4329-b8ce-f9ca4ea0d14b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.963230 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c7def668-10b0-4329-b8ce-f9ca4ea0d14b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.963552 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c7def668-10b0-4329-b8ce-f9ca4ea0d14b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.096775 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c7def668-10b0-4329-b8ce-f9ca4ea0d14b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:53.105266 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c7def668-10b0-4329-b8ce-f9ca4ea0d14b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:53.106697 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c7def668-10b0-4329-b8ce-f9ca4ea0d14b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:53.107874 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-c7def668-10b0-4329-b8ce-f9ca4ea0d14b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.159361 Oct 28 19:08:53.108430 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 204/423] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:52 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:53.207489 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-41dc03d2-a4d5-4c02-9108-bfe7d3de9b6b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:53.208063 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-41dc03d2-a4d5-4c02-9108-bfe7d3de9b6b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:53.213882 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-41dc03d2-a4d5-4c02-9108-bfe7d3de9b6b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.214957 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-41dc03d2-a4d5-4c02-9108-bfe7d3de9b6b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.215416 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-41dc03d2-a4d5-4c02-9108-bfe7d3de9b6b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.216100 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-41dc03d2-a4d5-4c02-9108-bfe7d3de9b6b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.216551 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-41dc03d2-a4d5-4c02-9108-bfe7d3de9b6b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.216978 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-41dc03d2-a4d5-4c02-9108-bfe7d3de9b6b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.236376 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=100 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:53.359050 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-41dc03d2-a4d5-4c02-9108-bfe7d3de9b6b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:53.367633 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-41dc03d2-a4d5-4c02-9108-bfe7d3de9b6b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1314 microversion: 2.1 time: 0.164152 Oct 28 19:08:53.368210 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 220/424] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:53 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:53.402023 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-faebcfa2-b56d-4037-9645-8047ca58116e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:53.402960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-faebcfa2-b56d-4037-9645-8047ca58116e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:53.405374 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell0:SELECT=4 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:53.406262 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell0:SELECT=16 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:53.411724 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-faebcfa2-b56d-4037-9645-8047ca58116e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.412357 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-faebcfa2-b56d-4037-9645-8047ca58116e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.412805 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-faebcfa2-b56d-4037-9645-8047ca58116e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.413539 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-faebcfa2-b56d-4037-9645-8047ca58116e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.413997 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-faebcfa2-b56d-4037-9645-8047ca58116e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.414422 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-faebcfa2-b56d-4037-9645-8047ca58116e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.420258 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=100 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:53.552898 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-faebcfa2-b56d-4037-9645-8047ca58116e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:53.561281 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-faebcfa2-b56d-4037-9645-8047ca58116e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1724 microversion: 2.1 time: 0.163749 Oct 28 19:08:53.562047 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 205/425] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:53 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:53.854257 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-9945e9ce-4263-4156-8d54-69345c03c4e0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:53.855481 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-9945e9ce-4263-4156-8d54-69345c03c4e0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:53.857384 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=4 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:53.862803 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9945e9ce-4263-4156-8d54-69345c03c4e0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.863324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9945e9ce-4263-4156-8d54-69345c03c4e0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.863762 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9945e9ce-4263-4156-8d54-69345c03c4e0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.864458 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9945e9ce-4263-4156-8d54-69345c03c4e0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.864910 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9945e9ce-4263-4156-8d54-69345c03c4e0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.865336 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9945e9ce-4263-4156-8d54-69345c03c4e0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.004812 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-9945e9ce-4263-4156-8d54-69345c03c4e0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:54.013263 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-9945e9ce-4263-4156-8d54-69345c03c4e0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1372 microversion: 2.1 time: 0.162843 Oct 28 19:08:54.013840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 221/426] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:53 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:54.135776 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-af3ba09a-c0b2-425e-9802-6187e1531c6d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:54.136801 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-af3ba09a-c0b2-425e-9802-6187e1531c6d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:54.144746 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-af3ba09a-c0b2-425e-9802-6187e1531c6d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.145233 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-af3ba09a-c0b2-425e-9802-6187e1531c6d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.145668 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-af3ba09a-c0b2-425e-9802-6187e1531c6d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.146367 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-af3ba09a-c0b2-425e-9802-6187e1531c6d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.146813 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-af3ba09a-c0b2-425e-9802-6187e1531c6d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.147264 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-af3ba09a-c0b2-425e-9802-6187e1531c6d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.286893 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-af3ba09a-c0b2-425e-9802-6187e1531c6d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:54.297197 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-af3ba09a-c0b2-425e-9802-6187e1531c6d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:54.298678 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-af3ba09a-c0b2-425e-9802-6187e1531c6d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:54.300091 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-af3ba09a-c0b2-425e-9802-6187e1531c6d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.168633 Oct 28 19:08:54.300852 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 206/427] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:54 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:54.394235 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4a72ed08-8297-4687-8549-5963b473b2ff tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:54.394854 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-4a72ed08-8297-4687-8549-5963b473b2ff tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:54.400911 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4a72ed08-8297-4687-8549-5963b473b2ff tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.401391 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4a72ed08-8297-4687-8549-5963b473b2ff tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.402367 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4a72ed08-8297-4687-8549-5963b473b2ff tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.403082 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4a72ed08-8297-4687-8549-5963b473b2ff tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.403538 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4a72ed08-8297-4687-8549-5963b473b2ff tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.403965 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4a72ed08-8297-4687-8549-5963b473b2ff tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.547557 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4a72ed08-8297-4687-8549-5963b473b2ff tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:54.555684 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-4a72ed08-8297-4687-8549-5963b473b2ff tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1314 microversion: 2.1 time: 0.165241 Oct 28 19:08:54.556261 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 222/428] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:54 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:54.585580 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-827602e0-4afb-43be-81a2-7cc695646006 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:54.586187 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-827602e0-4afb-43be-81a2-7cc695646006 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:54.592389 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-827602e0-4afb-43be-81a2-7cc695646006 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.592665 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-827602e0-4afb-43be-81a2-7cc695646006 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.593101 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-827602e0-4afb-43be-81a2-7cc695646006 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.593792 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-827602e0-4afb-43be-81a2-7cc695646006 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.594249 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-827602e0-4afb-43be-81a2-7cc695646006 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.594676 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-827602e0-4afb-43be-81a2-7cc695646006 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.726541 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-827602e0-4afb-43be-81a2-7cc695646006 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:54.735426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-827602e0-4afb-43be-81a2-7cc695646006 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1724 microversion: 2.1 time: 0.153609 Oct 28 19:08:54.735993 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 207/429] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:54 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:55.036384 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-0a63897f-9063-469b-8b6f-6c0a8ea3f819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:55.036987 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-0a63897f-9063-469b-8b6f-6c0a8ea3f819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:55.043544 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0a63897f-9063-469b-8b6f-6c0a8ea3f819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.044024 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0a63897f-9063-469b-8b6f-6c0a8ea3f819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.044459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0a63897f-9063-469b-8b6f-6c0a8ea3f819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.045141 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0a63897f-9063-469b-8b6f-6c0a8ea3f819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.045591 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0a63897f-9063-469b-8b6f-6c0a8ea3f819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.046049 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0a63897f-9063-469b-8b6f-6c0a8ea3f819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.171507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-0a63897f-9063-469b-8b6f-6c0a8ea3f819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:55.178965 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-0a63897f-9063-469b-8b6f-6c0a8ea3f819 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1372 microversion: 2.1 time: 0.146402 Oct 28 19:08:55.179547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 223/430] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:55 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:55.325198 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-63a1884c-45c9-4c44-8fb6-b2305ec1ae66 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:55.325806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-63a1884c-45c9-4c44-8fb6-b2305ec1ae66 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:55.332233 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-63a1884c-45c9-4c44-8fb6-b2305ec1ae66 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.332718 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-63a1884c-45c9-4c44-8fb6-b2305ec1ae66 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.333161 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-63a1884c-45c9-4c44-8fb6-b2305ec1ae66 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.333853 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-63a1884c-45c9-4c44-8fb6-b2305ec1ae66 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.334311 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-63a1884c-45c9-4c44-8fb6-b2305ec1ae66 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.334740 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-63a1884c-45c9-4c44-8fb6-b2305ec1ae66 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.467315 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-63a1884c-45c9-4c44-8fb6-b2305ec1ae66 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:55.477332 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-63a1884c-45c9-4c44-8fb6-b2305ec1ae66 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:55.478758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-63a1884c-45c9-4c44-8fb6-b2305ec1ae66 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:55.480471 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-63a1884c-45c9-4c44-8fb6-b2305ec1ae66 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.159351 Oct 28 19:08:55.481219 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 208/431] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:55 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:55.579533 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-3c4ec0dc-ad69-402e-a058-574b837abed9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:55.580183 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-3c4ec0dc-ad69-402e-a058-574b837abed9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:55.586214 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3c4ec0dc-ad69-402e-a058-574b837abed9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.586806 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3c4ec0dc-ad69-402e-a058-574b837abed9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.587334 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3c4ec0dc-ad69-402e-a058-574b837abed9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.588181 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3c4ec0dc-ad69-402e-a058-574b837abed9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.588698 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3c4ec0dc-ad69-402e-a058-574b837abed9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.589291 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3c4ec0dc-ad69-402e-a058-574b837abed9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.731782 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3c4ec0dc-ad69-402e-a058-574b837abed9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:55.740282 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-3c4ec0dc-ad69-402e-a058-574b837abed9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1314 microversion: 2.1 time: 0.164676 Oct 28 19:08:55.740778 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 224/432] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:55 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:55.760117 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-0fa24aaa-df0f-4f9e-a3ad-de7063d6ca73 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:55.761247 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-0fa24aaa-df0f-4f9e-a3ad-de7063d6ca73 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:55.768358 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0fa24aaa-df0f-4f9e-a3ad-de7063d6ca73 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.768838 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0fa24aaa-df0f-4f9e-a3ad-de7063d6ca73 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.769273 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0fa24aaa-df0f-4f9e-a3ad-de7063d6ca73 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.769961 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0fa24aaa-df0f-4f9e-a3ad-de7063d6ca73 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.770449 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0fa24aaa-df0f-4f9e-a3ad-de7063d6ca73 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.770875 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0fa24aaa-df0f-4f9e-a3ad-de7063d6ca73 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.909729 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-0fa24aaa-df0f-4f9e-a3ad-de7063d6ca73 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:55.918875 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-0fa24aaa-df0f-4f9e-a3ad-de7063d6ca73 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1701 microversion: 2.1 time: 0.162833 Oct 28 19:08:55.919486 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 209/433] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:55 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1701 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:55.941168 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f7588a9d-45e3-4c0d-94f3-ef4b99de0729 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:55.947056 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7588a9d-45e3-4c0d-94f3-ef4b99de0729 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.947562 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7588a9d-45e3-4c0d-94f3-ef4b99de0729 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.947994 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7588a9d-45e3-4c0d-94f3-ef4b99de0729 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.970434 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f7588a9d-45e3-4c0d-94f3-ef4b99de0729 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Going to try to start instance {{(pid=118874) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 19:08:56.013434 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f7588a9d-45e3-4c0d-94f3-ef4b99de0729 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "POST /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/action" status: 202 len: 0 microversion: 2.1 time: 0.076182 Oct 28 19:08:56.014283 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 225/434] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Oct 28 19:08:55 2022] POST /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:08:56.022952 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c88000aa-f0a9-4313-8faf-932f357479cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:56.023714 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-c88000aa-f0a9-4313-8faf-932f357479cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:56.033961 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c88000aa-f0a9-4313-8faf-932f357479cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.034449 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c88000aa-f0a9-4313-8faf-932f357479cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.034887 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c88000aa-f0a9-4313-8faf-932f357479cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.035616 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c88000aa-f0a9-4313-8faf-932f357479cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.036067 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c88000aa-f0a9-4313-8faf-932f357479cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.036494 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c88000aa-f0a9-4313-8faf-932f357479cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.041063 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-fdfa878b-ba83-487a-94f6-f1df2e3443a8 req-2f34229a-cec1-4058-b403-3bb30a41b44e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f", "tag": "92395a5b-edfc-4644-8dc9-9103854d9dac"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:56.051846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-fdfa878b-ba83-487a-94f6-f1df2e3443a8 req-2f34229a-cec1-4058-b403-3bb30a41b44e service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.052408 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-fdfa878b-ba83-487a-94f6-f1df2e3443a8 req-2f34229a-cec1-4058-b403-3bb30a41b44e service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.052827 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-fdfa878b-ba83-487a-94f6-f1df2e3443a8 req-2f34229a-cec1-4058-b403-3bb30a41b44e service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.064395 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-fdfa878b-ba83-487a-94f6-f1df2e3443a8 req-2f34229a-cec1-4058-b403-3bb30a41b44e service nova] Creating event network-changed:92395a5b-edfc-4644-8dc9-9103854d9dac for instance 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f on hv-cinder-86236 Oct 28 19:08:56.069379 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-fdfa878b-ba83-487a-94f6-f1df2e3443a8 req-2f34229a-cec1-4058-b403-3bb30a41b44e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040660 Oct 28 19:08:56.070110 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 226/435] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:08:56.170535 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c88000aa-f0a9-4313-8faf-932f357479cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:56.178756 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-c88000aa-f0a9-4313-8faf-932f357479cc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1710 microversion: 2.1 time: 0.160372 Oct 28 19:08:56.179362 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 210/436] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:56 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1710 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:56.202479 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1cee4541-f8c1-4d82-b353-d4cbd84ce24e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:56.203232 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-1cee4541-f8c1-4d82-b353-d4cbd84ce24e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:56.209268 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cee4541-f8c1-4d82-b353-d4cbd84ce24e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.209749 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cee4541-f8c1-4d82-b353-d4cbd84ce24e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.210186 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cee4541-f8c1-4d82-b353-d4cbd84ce24e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.210867 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cee4541-f8c1-4d82-b353-d4cbd84ce24e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.211358 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cee4541-f8c1-4d82-b353-d4cbd84ce24e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.211783 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cee4541-f8c1-4d82-b353-d4cbd84ce24e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.342616 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-1cee4541-f8c1-4d82-b353-d4cbd84ce24e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:56.350289 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-1cee4541-f8c1-4d82-b353-d4cbd84ce24e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1372 microversion: 2.1 time: 0.152484 Oct 28 19:08:56.350865 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 227/437] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:56 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:56.509779 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-fd87e799-098f-4071-9f6a-d229b19077a8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:56.510385 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-fd87e799-098f-4071-9f6a-d229b19077a8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:56.517024 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fd87e799-098f-4071-9f6a-d229b19077a8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.517729 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fd87e799-098f-4071-9f6a-d229b19077a8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.518167 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fd87e799-098f-4071-9f6a-d229b19077a8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.519073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fd87e799-098f-4071-9f6a-d229b19077a8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.519524 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fd87e799-098f-4071-9f6a-d229b19077a8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.520126 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fd87e799-098f-4071-9f6a-d229b19077a8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.683123 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-fd87e799-098f-4071-9f6a-d229b19077a8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:56.692808 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-fd87e799-098f-4071-9f6a-d229b19077a8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:56.694308 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-fd87e799-098f-4071-9f6a-d229b19077a8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:56.695511 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-fd87e799-098f-4071-9f6a-d229b19077a8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.189735 Oct 28 19:08:56.696084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 211/438] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:56 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:56.764711 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1b08525f-dcb7-4bf6-a655-6133278661f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:56.765576 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-1b08525f-dcb7-4bf6-a655-6133278661f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:56.771806 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1b08525f-dcb7-4bf6-a655-6133278661f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.772282 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1b08525f-dcb7-4bf6-a655-6133278661f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.772709 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1b08525f-dcb7-4bf6-a655-6133278661f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.773393 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1b08525f-dcb7-4bf6-a655-6133278661f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.773841 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1b08525f-dcb7-4bf6-a655-6133278661f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.774258 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1b08525f-dcb7-4bf6-a655-6133278661f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.904575 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-1b08525f-dcb7-4bf6-a655-6133278661f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:56.913424 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-1b08525f-dcb7-4bf6-a655-6133278661f6 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1314 microversion: 2.1 time: 0.153586 Oct 28 19:08:56.914180 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 228/439] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:56 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:57.202696 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-5ac7f6ba-459f-4453-a4b0-7b29ecff782a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:57.203293 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-5ac7f6ba-459f-4453-a4b0-7b29ecff782a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:57.209180 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5ac7f6ba-459f-4453-a4b0-7b29ecff782a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.209664 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5ac7f6ba-459f-4453-a4b0-7b29ecff782a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.210104 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5ac7f6ba-459f-4453-a4b0-7b29ecff782a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.210798 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5ac7f6ba-459f-4453-a4b0-7b29ecff782a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.211290 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5ac7f6ba-459f-4453-a4b0-7b29ecff782a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.211718 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5ac7f6ba-459f-4453-a4b0-7b29ecff782a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.340481 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-5ac7f6ba-459f-4453-a4b0-7b29ecff782a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:57.348645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-5ac7f6ba-459f-4453-a4b0-7b29ecff782a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1710 microversion: 2.1 time: 0.150443 Oct 28 19:08:57.349206 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 212/440] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:57 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:57.374247 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-46dbb974-c2b9-4887-a72b-7a30db2bd645 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:57.374859 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-46dbb974-c2b9-4887-a72b-7a30db2bd645 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:57.380657 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46dbb974-c2b9-4887-a72b-7a30db2bd645 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.381129 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46dbb974-c2b9-4887-a72b-7a30db2bd645 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.381559 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46dbb974-c2b9-4887-a72b-7a30db2bd645 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.382233 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46dbb974-c2b9-4887-a72b-7a30db2bd645 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.382679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46dbb974-c2b9-4887-a72b-7a30db2bd645 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.383211 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46dbb974-c2b9-4887-a72b-7a30db2bd645 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.568439 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-46dbb974-c2b9-4887-a72b-7a30db2bd645 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:57.577729 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-46dbb974-c2b9-4887-a72b-7a30db2bd645 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1372 microversion: 2.1 time: 0.208062 Oct 28 19:08:57.584001 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 229/441] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:57 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1372 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:57.721763 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d3cd4468-c5d4-4dae-8787-7365784aff9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:57.722303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d3cd4468-c5d4-4dae-8787-7365784aff9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:57.728655 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d3cd4468-c5d4-4dae-8787-7365784aff9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.729134 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d3cd4468-c5d4-4dae-8787-7365784aff9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.729570 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d3cd4468-c5d4-4dae-8787-7365784aff9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.730789 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d3cd4468-c5d4-4dae-8787-7365784aff9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.731265 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d3cd4468-c5d4-4dae-8787-7365784aff9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.731688 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d3cd4468-c5d4-4dae-8787-7365784aff9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.862269 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d3cd4468-c5d4-4dae-8787-7365784aff9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:57.871278 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d3cd4468-c5d4-4dae-8787-7365784aff9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:57.872724 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d3cd4468-c5d4-4dae-8787-7365784aff9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:57.873899 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d3cd4468-c5d4-4dae-8787-7365784aff9a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.156039 Oct 28 19:08:57.874445 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 213/442] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:57 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:57.937448 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-958d6aa6-5878-4593-a702-ddfaf0188024 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:57.938048 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-958d6aa6-5878-4593-a702-ddfaf0188024 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:57.943889 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-958d6aa6-5878-4593-a702-ddfaf0188024 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.944362 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-958d6aa6-5878-4593-a702-ddfaf0188024 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.944792 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-958d6aa6-5878-4593-a702-ddfaf0188024 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.945464 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-958d6aa6-5878-4593-a702-ddfaf0188024 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.945909 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-958d6aa6-5878-4593-a702-ddfaf0188024 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.946325 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-958d6aa6-5878-4593-a702-ddfaf0188024 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.072977 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-958d6aa6-5878-4593-a702-ddfaf0188024 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:58.080714 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-958d6aa6-5878-4593-a702-ddfaf0188024 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1314 microversion: 2.1 time: 0.147781 Oct 28 19:08:58.081280 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 230/443] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:57 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:58.372532 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-144c5f0a-06c4-4f83-ab61-2dc2bb3ba35b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:58.373594 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-144c5f0a-06c4-4f83-ab61-2dc2bb3ba35b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:58.380336 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-144c5f0a-06c4-4f83-ab61-2dc2bb3ba35b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.380837 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-144c5f0a-06c4-4f83-ab61-2dc2bb3ba35b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.381280 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-144c5f0a-06c4-4f83-ab61-2dc2bb3ba35b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.381996 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-144c5f0a-06c4-4f83-ab61-2dc2bb3ba35b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.382454 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-144c5f0a-06c4-4f83-ab61-2dc2bb3ba35b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.382891 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-144c5f0a-06c4-4f83-ab61-2dc2bb3ba35b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.556329 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-144c5f0a-06c4-4f83-ab61-2dc2bb3ba35b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:58.565329 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-144c5f0a-06c4-4f83-ab61-2dc2bb3ba35b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1710 microversion: 2.1 time: 0.197634 Oct 28 19:08:58.565914 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 214/444] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:58 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1710 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:58.600945 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-0a588473-9607-4190-b6cf-d9b68b6a0c11 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:58.601543 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-0a588473-9607-4190-b6cf-d9b68b6a0c11 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:58.608668 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0a588473-9607-4190-b6cf-d9b68b6a0c11 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.609161 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0a588473-9607-4190-b6cf-d9b68b6a0c11 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.609709 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0a588473-9607-4190-b6cf-d9b68b6a0c11 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.610436 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0a588473-9607-4190-b6cf-d9b68b6a0c11 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.611002 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0a588473-9607-4190-b6cf-d9b68b6a0c11 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.611642 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0a588473-9607-4190-b6cf-d9b68b6a0c11 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.743744 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-0a588473-9607-4190-b6cf-d9b68b6a0c11 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:58.751536 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-0a588473-9607-4190-b6cf-d9b68b6a0c11 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1372 microversion: 2.1 time: 0.154551 Oct 28 19:08:58.752138 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 231/445] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:58 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:58.898751 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-56bcc2ef-2d63-4b0c-bedb-bca441fea2fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:58.899368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-56bcc2ef-2d63-4b0c-bedb-bca441fea2fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:58.905754 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-56bcc2ef-2d63-4b0c-bedb-bca441fea2fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.906228 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-56bcc2ef-2d63-4b0c-bedb-bca441fea2fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.906665 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-56bcc2ef-2d63-4b0c-bedb-bca441fea2fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.907370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-56bcc2ef-2d63-4b0c-bedb-bca441fea2fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.907822 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-56bcc2ef-2d63-4b0c-bedb-bca441fea2fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.908243 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-56bcc2ef-2d63-4b0c-bedb-bca441fea2fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:59.033097 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-56bcc2ef-2d63-4b0c-bedb-bca441fea2fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:59.041690 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-56bcc2ef-2d63-4b0c-bedb-bca441fea2fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:59.043796 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-56bcc2ef-2d63-4b0c-bedb-bca441fea2fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:59.044934 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-56bcc2ef-2d63-4b0c-bedb-bca441fea2fe tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.150040 Oct 28 19:08:59.045487 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 215/446] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:58 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:59.104059 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-46b1a3c3-0155-480d-a58b-e40f39a8a68d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:59.104654 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-46b1a3c3-0155-480d-a58b-e40f39a8a68d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:59.110493 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46b1a3c3-0155-480d-a58b-e40f39a8a68d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:59.110961 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46b1a3c3-0155-480d-a58b-e40f39a8a68d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:59.111485 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46b1a3c3-0155-480d-a58b-e40f39a8a68d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:59.112159 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46b1a3c3-0155-480d-a58b-e40f39a8a68d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:59.112602 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46b1a3c3-0155-480d-a58b-e40f39a8a68d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:59.113015 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46b1a3c3-0155-480d-a58b-e40f39a8a68d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:59.239372 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-46b1a3c3-0155-480d-a58b-e40f39a8a68d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:59.247452 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-46b1a3c3-0155-480d-a58b-e40f39a8a68d tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1498 microversion: 2.1 time: 0.147462 Oct 28 19:08:59.248005 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 232/447] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:59 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:59.587959 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-3fd5bdc1-9625-4f03-8aee-370afb9876bf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:59.588650 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-3fd5bdc1-9625-4f03-8aee-370afb9876bf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:59.595605 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3fd5bdc1-9625-4f03-8aee-370afb9876bf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:59.596181 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3fd5bdc1-9625-4f03-8aee-370afb9876bf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:59.596631 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3fd5bdc1-9625-4f03-8aee-370afb9876bf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:59.597322 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3fd5bdc1-9625-4f03-8aee-370afb9876bf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:59.597776 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3fd5bdc1-9625-4f03-8aee-370afb9876bf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:59.598198 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3fd5bdc1-9625-4f03-8aee-370afb9876bf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:59.726275 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3fd5bdc1-9625-4f03-8aee-370afb9876bf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:59.735089 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-3fd5bdc1-9625-4f03-8aee-370afb9876bf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1710 microversion: 2.1 time: 0.150872 Oct 28 19:08:59.735659 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 216/448] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:59 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:59.773639 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-19dc5043-544c-4552-8c84-a873c6f62f44 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:59.774232 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-19dc5043-544c-4552-8c84-a873c6f62f44 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:59.781320 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-19dc5043-544c-4552-8c84-a873c6f62f44 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:59.781810 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-19dc5043-544c-4552-8c84-a873c6f62f44 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:59.782224 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-19dc5043-544c-4552-8c84-a873c6f62f44 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:59.782903 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-19dc5043-544c-4552-8c84-a873c6f62f44 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:59.783378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-19dc5043-544c-4552-8c84-a873c6f62f44 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:59.783794 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-19dc5043-544c-4552-8c84-a873c6f62f44 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:59.853734 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-77a80c86-105e-4f25-954c-acd46bf4adac tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:59.854369 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-77a80c86-105e-4f25-954c-acd46bf4adac tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:59.860138 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-77a80c86-105e-4f25-954c-acd46bf4adac tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:59.860625 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-77a80c86-105e-4f25-954c-acd46bf4adac tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:59.861065 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-77a80c86-105e-4f25-954c-acd46bf4adac tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:59.861755 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-77a80c86-105e-4f25-954c-acd46bf4adac tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:59.862209 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-77a80c86-105e-4f25-954c-acd46bf4adac tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:59.862635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-77a80c86-105e-4f25-954c-acd46bf4adac tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:59.893337 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-77a80c86-105e-4f25-954c-acd46bf4adac tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Going to try to terminate instance {{(pid=118875) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:08:59.919293 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-19dc5043-544c-4552-8c84-a873c6f62f44 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:59.926939 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-19dc5043-544c-4552-8c84-a873c6f62f44 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1372 microversion: 2.1 time: 0.157156 Oct 28 19:08:59.927526 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 233/449] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:59 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:59.969440 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-77a80c86-105e-4f25-954c-acd46bf4adac tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "DELETE /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 204 len: 0 microversion: 2.1 time: 0.119390 Oct 28 19:08:59.970130 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 217/450] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Oct 28 19:08:59 2022] DELETE /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:08:59.978349 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-0759d792-976b-4641-9c8a-3d6cf92323b9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:59.978965 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-0759d792-976b-4641-9c8a-3d6cf92323b9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:59.984921 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0759d792-976b-4641-9c8a-3d6cf92323b9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:59.985405 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0759d792-976b-4641-9c8a-3d6cf92323b9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:59.985846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0759d792-976b-4641-9c8a-3d6cf92323b9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:59.986568 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0759d792-976b-4641-9c8a-3d6cf92323b9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:59.987042 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0759d792-976b-4641-9c8a-3d6cf92323b9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:59.987469 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0759d792-976b-4641-9c8a-3d6cf92323b9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:00.070480 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-01e8d4a4-b559-469f-9a18-f2436a7f0e0e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:00.071196 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-01e8d4a4-b559-469f-9a18-f2436a7f0e0e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:00.077561 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-01e8d4a4-b559-469f-9a18-f2436a7f0e0e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:00.078052 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-01e8d4a4-b559-469f-9a18-f2436a7f0e0e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:00.078489 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-01e8d4a4-b559-469f-9a18-f2436a7f0e0e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:00.079210 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-01e8d4a4-b559-469f-9a18-f2436a7f0e0e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:00.079666 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-01e8d4a4-b559-469f-9a18-f2436a7f0e0e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:00.080090 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-01e8d4a4-b559-469f-9a18-f2436a7f0e0e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:00.116105 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-0759d792-976b-4641-9c8a-3d6cf92323b9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:00.123974 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-0759d792-976b-4641-9c8a-3d6cf92323b9 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1504 microversion: 2.1 time: 0.149460 Oct 28 19:09:00.124645 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 234/451] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:59 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:00.207743 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-01e8d4a4-b559-469f-9a18-f2436a7f0e0e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:00.216980 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-01e8d4a4-b559-469f-9a18-f2436a7f0e0e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:00.218706 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-01e8d4a4-b559-469f-9a18-f2436a7f0e0e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:00.219903 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-01e8d4a4-b559-469f-9a18-f2436a7f0e0e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.154068 Oct 28 19:09:00.220463 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 218/452] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:00 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:09:00.759025 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-3b00045f-a9f9-4089-9611-acec76e789de tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:00.759664 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-3b00045f-a9f9-4089-9611-acec76e789de tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:00.766328 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3b00045f-a9f9-4089-9611-acec76e789de tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:00.766800 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3b00045f-a9f9-4089-9611-acec76e789de tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:00.767263 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3b00045f-a9f9-4089-9611-acec76e789de tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:00.767944 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3b00045f-a9f9-4089-9611-acec76e789de tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:00.768391 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3b00045f-a9f9-4089-9611-acec76e789de tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:00.768816 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3b00045f-a9f9-4089-9611-acec76e789de tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:00.896690 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3b00045f-a9f9-4089-9611-acec76e789de tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:00.904844 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-3b00045f-a9f9-4089-9611-acec76e789de tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1710 microversion: 2.1 time: 0.149744 Oct 28 19:09:00.905405 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 235/453] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:00 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:00.950494 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c55d150a-f2bf-4204-b5fc-ea9765979440 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:00.951136 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-c55d150a-f2bf-4204-b5fc-ea9765979440 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:00.957535 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c55d150a-f2bf-4204-b5fc-ea9765979440 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:00.958033 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c55d150a-f2bf-4204-b5fc-ea9765979440 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:00.958449 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c55d150a-f2bf-4204-b5fc-ea9765979440 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:00.959176 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c55d150a-f2bf-4204-b5fc-ea9765979440 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:00.959627 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c55d150a-f2bf-4204-b5fc-ea9765979440 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:00.960053 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c55d150a-f2bf-4204-b5fc-ea9765979440 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.083958 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c55d150a-f2bf-4204-b5fc-ea9765979440 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:01.091980 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-c55d150a-f2bf-4204-b5fc-ea9765979440 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1372 microversion: 2.1 time: 0.145417 Oct 28 19:09:01.092549 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 219/454] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:00 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1372 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:01.148850 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-48ba745e-399e-444f-a666-9ebbdd1919b7 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:01.149460 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-48ba745e-399e-444f-a666-9ebbdd1919b7 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:01.155929 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-48ba745e-399e-444f-a666-9ebbdd1919b7 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.156405 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-48ba745e-399e-444f-a666-9ebbdd1919b7 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.156838 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-48ba745e-399e-444f-a666-9ebbdd1919b7 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.157520 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-48ba745e-399e-444f-a666-9ebbdd1919b7 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.157969 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-48ba745e-399e-444f-a666-9ebbdd1919b7 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.158391 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-48ba745e-399e-444f-a666-9ebbdd1919b7 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.244215 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-ad4baeb9-0d84-41b4-91fc-b7260c8f5230 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:01.244815 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-ad4baeb9-0d84-41b4-91fc-b7260c8f5230 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:01.250573 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ad4baeb9-0d84-41b4-91fc-b7260c8f5230 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.251093 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ad4baeb9-0d84-41b4-91fc-b7260c8f5230 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.251532 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ad4baeb9-0d84-41b4-91fc-b7260c8f5230 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.252220 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ad4baeb9-0d84-41b4-91fc-b7260c8f5230 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.252670 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ad4baeb9-0d84-41b4-91fc-b7260c8f5230 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.253093 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ad4baeb9-0d84-41b4-91fc-b7260c8f5230 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.257083 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:01.284416 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-48ba745e-399e-444f-a666-9ebbdd1919b7 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:01.288189 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:01.293868 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-48ba745e-399e-444f-a666-9ebbdd1919b7 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1504 microversion: 2.1 time: 0.148823 Oct 28 19:09:01.294436 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 236/455] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:01 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:01.383709 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ad4baeb9-0d84-41b4-91fc-b7260c8f5230 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:01.392978 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ad4baeb9-0d84-41b4-91fc-b7260c8f5230 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:01.394417 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ad4baeb9-0d84-41b4-91fc-b7260c8f5230 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:01.395600 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-ad4baeb9-0d84-41b4-91fc-b7260c8f5230 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.155216 Oct 28 19:09:01.396151 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 220/456] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:01 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:09:01.929106 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-9fa58243-b658-428a-b438-868adc55b104 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:01.929636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-9fa58243-b658-428a-b438-868adc55b104 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:01.936678 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9fa58243-b658-428a-b438-868adc55b104 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.937158 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9fa58243-b658-428a-b438-868adc55b104 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.937594 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9fa58243-b658-428a-b438-868adc55b104 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.938280 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9fa58243-b658-428a-b438-868adc55b104 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.938791 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9fa58243-b658-428a-b438-868adc55b104 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.939390 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9fa58243-b658-428a-b438-868adc55b104 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.066262 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-9fa58243-b658-428a-b438-868adc55b104 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:02.075252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-9fa58243-b658-428a-b438-868adc55b104 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1714 microversion: 2.1 time: 0.150609 Oct 28 19:09:02.075815 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 237/457] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:01 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:02.114199 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-ff2da01b-ac6a-4079-ba1c-9d21e297769e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:02.114807 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-ff2da01b-ac6a-4079-ba1c-9d21e297769e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:02.121733 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ff2da01b-ac6a-4079-ba1c-9d21e297769e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.122216 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ff2da01b-ac6a-4079-ba1c-9d21e297769e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.122658 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ff2da01b-ac6a-4079-ba1c-9d21e297769e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.123382 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ff2da01b-ac6a-4079-ba1c-9d21e297769e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.123838 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ff2da01b-ac6a-4079-ba1c-9d21e297769e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.124267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ff2da01b-ac6a-4079-ba1c-9d21e297769e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.251644 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ff2da01b-ac6a-4079-ba1c-9d21e297769e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:02.259166 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-ff2da01b-ac6a-4079-ba1c-9d21e297769e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1372 microversion: 2.1 time: 0.148740 Oct 28 19:09:02.259737 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 221/458] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:02 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:02.316574 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-e806ce18-c7f4-42eb-a132-657928a85b97 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:02.317214 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-e806ce18-c7f4-42eb-a132-657928a85b97 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:02.320221 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=100 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:02.324450 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e806ce18-c7f4-42eb-a132-657928a85b97 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.324932 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e806ce18-c7f4-42eb-a132-657928a85b97 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.325365 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e806ce18-c7f4-42eb-a132-657928a85b97 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.326058 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e806ce18-c7f4-42eb-a132-657928a85b97 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.326506 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e806ce18-c7f4-42eb-a132-657928a85b97 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.326927 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e806ce18-c7f4-42eb-a132-657928a85b97 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.420946 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-a18ce3d5-3a82-47a8-bfdf-29ad6f21e712 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:02.421641 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-a18ce3d5-3a82-47a8-bfdf-29ad6f21e712 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:02.427925 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a18ce3d5-3a82-47a8-bfdf-29ad6f21e712 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.428477 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a18ce3d5-3a82-47a8-bfdf-29ad6f21e712 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.428984 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a18ce3d5-3a82-47a8-bfdf-29ad6f21e712 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.429742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a18ce3d5-3a82-47a8-bfdf-29ad6f21e712 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.430259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a18ce3d5-3a82-47a8-bfdf-29ad6f21e712 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.430750 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a18ce3d5-3a82-47a8-bfdf-29ad6f21e712 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.461913 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e806ce18-c7f4-42eb-a132-657928a85b97 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:02.471825 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-e806ce18-c7f4-42eb-a132-657928a85b97 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1504 microversion: 2.1 time: 0.158632 Oct 28 19:09:02.487449 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 238/459] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:02 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:02.575498 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a18ce3d5-3a82-47a8-bfdf-29ad6f21e712 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:02.585663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a18ce3d5-3a82-47a8-bfdf-29ad6f21e712 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:02.587186 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a18ce3d5-3a82-47a8-bfdf-29ad6f21e712 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:02.588334 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-a18ce3d5-3a82-47a8-bfdf-29ad6f21e712 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.171986 Oct 28 19:09:02.588936 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 222/460] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:02 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:03.281570 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-03e38229-859b-4783-953a-89a878d1aec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:03.282190 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-03e38229-859b-4783-953a-89a878d1aec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:03.288084 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-03e38229-859b-4783-953a-89a878d1aec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.288561 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-03e38229-859b-4783-953a-89a878d1aec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.288994 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-03e38229-859b-4783-953a-89a878d1aec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.289673 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-03e38229-859b-4783-953a-89a878d1aec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.290121 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-03e38229-859b-4783-953a-89a878d1aec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.290539 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-03e38229-859b-4783-953a-89a878d1aec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.415190 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-03e38229-859b-4783-953a-89a878d1aec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:03.422625 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-03e38229-859b-4783-953a-89a878d1aec6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1372 microversion: 2.1 time: 0.144919 Oct 28 19:09:03.423208 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 239/461] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:03 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1372 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:03.498841 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-131cfa9d-7347-480c-bba7-54ce353a2860 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:03.499554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-131cfa9d-7347-480c-bba7-54ce353a2860 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:03.505964 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-131cfa9d-7347-480c-bba7-54ce353a2860 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.506443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-131cfa9d-7347-480c-bba7-54ce353a2860 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.506880 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-131cfa9d-7347-480c-bba7-54ce353a2860 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.507590 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-131cfa9d-7347-480c-bba7-54ce353a2860 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.508039 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-131cfa9d-7347-480c-bba7-54ce353a2860 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.508460 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-131cfa9d-7347-480c-bba7-54ce353a2860 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.612837 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-cdae0376-18ef-4def-ad60-97110ab82229 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:03.613459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-cdae0376-18ef-4def-ad60-97110ab82229 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:03.619216 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cdae0376-18ef-4def-ad60-97110ab82229 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.619684 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cdae0376-18ef-4def-ad60-97110ab82229 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.620694 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cdae0376-18ef-4def-ad60-97110ab82229 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.621372 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cdae0376-18ef-4def-ad60-97110ab82229 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.621815 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cdae0376-18ef-4def-ad60-97110ab82229 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.622230 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cdae0376-18ef-4def-ad60-97110ab82229 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.638419 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-131cfa9d-7347-480c-bba7-54ce353a2860 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:03.646112 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-131cfa9d-7347-480c-bba7-54ce353a2860 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1504 microversion: 2.1 time: 0.151593 Oct 28 19:09:03.646678 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 223/462] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:03 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:03.753522 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-cdae0376-18ef-4def-ad60-97110ab82229 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:03.762705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-cdae0376-18ef-4def-ad60-97110ab82229 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:03.764177 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-cdae0376-18ef-4def-ad60-97110ab82229 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:03.765330 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-cdae0376-18ef-4def-ad60-97110ab82229 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.156371 Oct 28 19:09:03.765881 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 240/463] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:03 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:09:04.447969 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d88052af-4cbb-4d11-9684-1d8c54e1e041 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:04.450572 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d88052af-4cbb-4d11-9684-1d8c54e1e041 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:04.456473 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d88052af-4cbb-4d11-9684-1d8c54e1e041 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:04.457135 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d88052af-4cbb-4d11-9684-1d8c54e1e041 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:04.457894 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d88052af-4cbb-4d11-9684-1d8c54e1e041 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:04.459721 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d88052af-4cbb-4d11-9684-1d8c54e1e041 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:04.460517 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d88052af-4cbb-4d11-9684-1d8c54e1e041 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:04.461124 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d88052af-4cbb-4d11-9684-1d8c54e1e041 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:04.520268 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-3e350e62-dd54-46bc-8167-9751a3ea816a req-7f3f4c8e-5a64-4cf0-9e6f-76e491c0edc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f", "name": "network-vif-plugged", "status": "completed", "tag": "92395a5b-edfc-4644-8dc9-9103854d9dac"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:04.531275 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-3e350e62-dd54-46bc-8167-9751a3ea816a req-7f3f4c8e-5a64-4cf0-9e6f-76e491c0edc2 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:04.531890 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-3e350e62-dd54-46bc-8167-9751a3ea816a req-7f3f4c8e-5a64-4cf0-9e6f-76e491c0edc2 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:04.532682 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-3e350e62-dd54-46bc-8167-9751a3ea816a req-7f3f4c8e-5a64-4cf0-9e6f-76e491c0edc2 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:04.549219 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-3e350e62-dd54-46bc-8167-9751a3ea816a req-7f3f4c8e-5a64-4cf0-9e6f-76e491c0edc2 service nova] Creating event network-vif-plugged:92395a5b-edfc-4644-8dc9-9103854d9dac for instance 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f on hv-cinder-86236 Oct 28 19:09:04.556837 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-3e350e62-dd54-46bc-8167-9751a3ea816a req-7f3f4c8e-5a64-4cf0-9e6f-76e491c0edc2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040177 Oct 28 19:09:04.557903 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 241/464] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:09:04.626738 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-4e04c517-fded-4779-9f40-a1bcd27b3342 req-4982db75-1680-45d5-91aa-725c64eb4fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41cb05e8-8ade-4928-b7c1-da54775e7a17", "name": "network-vif-deleted", "tag": "9efbcaf2-ba96-40ed-a555-d555ac985dc7"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:04.637139 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-4e04c517-fded-4779-9f40-a1bcd27b3342 req-4982db75-1680-45d5-91aa-725c64eb4fdd service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:04.637608 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-4e04c517-fded-4779-9f40-a1bcd27b3342 req-4982db75-1680-45d5-91aa-725c64eb4fdd service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:04.638037 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-4e04c517-fded-4779-9f40-a1bcd27b3342 req-4982db75-1680-45d5-91aa-725c64eb4fdd service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:04.649843 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-4e04c517-fded-4779-9f40-a1bcd27b3342 req-4982db75-1680-45d5-91aa-725c64eb4fdd service nova] Creating event network-vif-deleted:9efbcaf2-ba96-40ed-a555-d555ac985dc7 for instance 41cb05e8-8ade-4928-b7c1-da54775e7a17 on hv-cinder-86236 Oct 28 19:09:04.655237 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-4e04c517-fded-4779-9f40-a1bcd27b3342 req-4982db75-1680-45d5-91aa-725c64eb4fdd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032481 Oct 28 19:09:04.655830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 242/465] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:09:04.669735 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-0f8d0031-3a26-4068-8cd6-f4fba34f0076 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:04.670415 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-0f8d0031-3a26-4068-8cd6-f4fba34f0076 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:04.676481 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0f8d0031-3a26-4068-8cd6-f4fba34f0076 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:04.676955 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0f8d0031-3a26-4068-8cd6-f4fba34f0076 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:04.677386 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0f8d0031-3a26-4068-8cd6-f4fba34f0076 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:04.678061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0f8d0031-3a26-4068-8cd6-f4fba34f0076 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:04.678504 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0f8d0031-3a26-4068-8cd6-f4fba34f0076 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:04.678919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0f8d0031-3a26-4068-8cd6-f4fba34f0076 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:04.683520 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d88052af-4cbb-4d11-9684-1d8c54e1e041 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:04.691195 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d88052af-4cbb-4d11-9684-1d8c54e1e041 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1372 microversion: 2.1 time: 0.248552 Oct 28 19:09:04.691898 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 224/466] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:04 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1372 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:04.741242 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-0f8d0031-3a26-4068-8cd6-f4fba34f0076 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:04.749594 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-0f8d0031-3a26-4068-8cd6-f4fba34f0076 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1462 microversion: 2.1 time: 0.083828 Oct 28 19:09:04.750172 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 243/467] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:04 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1462 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:04.790399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b175fee0-a85c-4baa-9f2c-d79e5bba6a9b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:04.791043 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b175fee0-a85c-4baa-9f2c-d79e5bba6a9b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:04.798137 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b175fee0-a85c-4baa-9f2c-d79e5bba6a9b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:04.798635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b175fee0-a85c-4baa-9f2c-d79e5bba6a9b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:04.799114 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b175fee0-a85c-4baa-9f2c-d79e5bba6a9b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:04.799822 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b175fee0-a85c-4baa-9f2c-d79e5bba6a9b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:04.800277 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b175fee0-a85c-4baa-9f2c-d79e5bba6a9b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:04.800708 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b175fee0-a85c-4baa-9f2c-d79e5bba6a9b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:04.936521 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b175fee0-a85c-4baa-9f2c-d79e5bba6a9b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:04.945347 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b175fee0-a85c-4baa-9f2c-d79e5bba6a9b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:04.946733 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b175fee0-a85c-4baa-9f2c-d79e5bba6a9b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:04.947906 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b175fee0-a85c-4baa-9f2c-d79e5bba6a9b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.161681 Oct 28 19:09:04.949150 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 225/468] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:04 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:05.714569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-47cae034-5e1e-41f9-8d4a-ebdebb535e5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:05.715194 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-47cae034-5e1e-41f9-8d4a-ebdebb535e5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:05.721144 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-47cae034-5e1e-41f9-8d4a-ebdebb535e5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.721617 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-47cae034-5e1e-41f9-8d4a-ebdebb535e5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.722066 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-47cae034-5e1e-41f9-8d4a-ebdebb535e5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.722720 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-47cae034-5e1e-41f9-8d4a-ebdebb535e5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.723198 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-47cae034-5e1e-41f9-8d4a-ebdebb535e5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.723618 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-47cae034-5e1e-41f9-8d4a-ebdebb535e5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.774271 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-2b92e52a-0886-43d6-96a2-b8525900e7c8 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:05.775123 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-2b92e52a-0886-43d6-96a2-b8525900e7c8 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:05.781748 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2b92e52a-0886-43d6-96a2-b8525900e7c8 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.782238 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2b92e52a-0886-43d6-96a2-b8525900e7c8 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.782679 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2b92e52a-0886-43d6-96a2-b8525900e7c8 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.783437 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2b92e52a-0886-43d6-96a2-b8525900e7c8 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.783888 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2b92e52a-0886-43d6-96a2-b8525900e7c8 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.784317 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2b92e52a-0886-43d6-96a2-b8525900e7c8 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.815223 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2b92e52a-0886-43d6-96a2-b8525900e7c8 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.815707 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2b92e52a-0886-43d6-96a2-b8525900e7c8 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.816144 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2b92e52a-0886-43d6-96a2-b8525900e7c8 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.816587 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.objects.instance [None req-2b92e52a-0886-43d6-96a2-b8525900e7c8 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lazy-loading 'fault' on Instance uuid 41cb05e8-8ade-4928-b7c1-da54775e7a17 {{(pid=118875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:09:05.865932 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2b92e52a-0886-43d6-96a2-b8525900e7c8 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:05.874556 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-2b92e52a-0886-43d6-96a2-b8525900e7c8 tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1304 microversion: 2.1 time: 0.105021 Oct 28 19:09:05.875159 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 226/469] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:05 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:05.880351 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-47cae034-5e1e-41f9-8d4a-ebdebb535e5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:05.888503 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-47cae034-5e1e-41f9-8d4a-ebdebb535e5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1372 microversion: 2.1 time: 0.178286 Oct 28 19:09:05.889137 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 244/470] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:05 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:05.974160 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-32179011-7dc1-4c67-87c0-3854f7f805ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:05.974797 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-32179011-7dc1-4c67-87c0-3854f7f805ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:05.981544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-32179011-7dc1-4c67-87c0-3854f7f805ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.982029 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-32179011-7dc1-4c67-87c0-3854f7f805ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.982577 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-32179011-7dc1-4c67-87c0-3854f7f805ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.983345 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-32179011-7dc1-4c67-87c0-3854f7f805ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.983814 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-32179011-7dc1-4c67-87c0-3854f7f805ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.984250 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-32179011-7dc1-4c67-87c0-3854f7f805ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:06.114105 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-32179011-7dc1-4c67-87c0-3854f7f805ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:06.123169 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-32179011-7dc1-4c67-87c0-3854f7f805ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:06.124623 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-32179011-7dc1-4c67-87c0-3854f7f805ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:06.125775 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-32179011-7dc1-4c67-87c0-3854f7f805ee tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.155576 Oct 28 19:09:06.126330 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 227/471] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:05 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:06.899598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a8180072-95f6-44ef-b21d-df4001519c8b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:06.900136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-a8180072-95f6-44ef-b21d-df4001519c8b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:06.906627 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a8180072-95f6-44ef-b21d-df4001519c8b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:06.907134 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a8180072-95f6-44ef-b21d-df4001519c8b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:06.907562 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a8180072-95f6-44ef-b21d-df4001519c8b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:06.908239 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a8180072-95f6-44ef-b21d-df4001519c8b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:06.908683 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a8180072-95f6-44ef-b21d-df4001519c8b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:06.909101 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a8180072-95f6-44ef-b21d-df4001519c8b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:06.911031 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-0290ff70-2412-4381-9c90-7c6c96f3ac30 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:06.911642 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-0290ff70-2412-4381-9c90-7c6c96f3ac30 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:06.918522 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0290ff70-2412-4381-9c90-7c6c96f3ac30 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:06.919022 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0290ff70-2412-4381-9c90-7c6c96f3ac30 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:06.919469 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0290ff70-2412-4381-9c90-7c6c96f3ac30 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:06.920156 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0290ff70-2412-4381-9c90-7c6c96f3ac30 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:06.920623 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0290ff70-2412-4381-9c90-7c6c96f3ac30 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:06.921043 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0290ff70-2412-4381-9c90-7c6c96f3ac30 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:06.940302 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a8180072-95f6-44ef-b21d-df4001519c8b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:06.940769 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a8180072-95f6-44ef-b21d-df4001519c8b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:06.941190 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a8180072-95f6-44ef-b21d-df4001519c8b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:06.941625 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.objects.instance [None req-a8180072-95f6-44ef-b21d-df4001519c8b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lazy-loading 'fault' on Instance uuid 41cb05e8-8ade-4928-b7c1-da54775e7a17 {{(pid=118874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:09:07.012774 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-a8180072-95f6-44ef-b21d-df4001519c8b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9a97e40b054a3fad1bd12e80c26708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0121d8f74bf441afb820f567988c4d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:07.021104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-a8180072-95f6-44ef-b21d-df4001519c8b tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 200 len: 1304 microversion: 2.1 time: 0.125670 Oct 28 19:09:07.021712 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 245/472] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:06 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:07.076376 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-0290ff70-2412-4381-9c90-7c6c96f3ac30 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:07.083971 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-0290ff70-2412-4381-9c90-7c6c96f3ac30 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1566 microversion: 2.1 time: 0.176756 Oct 28 19:09:07.084541 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 228/473] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:06 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:07.107490 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-caec684e-8039-4db4-986c-fdb38a24b8ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:07.107983 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-caec684e-8039-4db4-986c-fdb38a24b8ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:07.114104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-caec684e-8039-4db4-986c-fdb38a24b8ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:07.115137 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-caec684e-8039-4db4-986c-fdb38a24b8ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:07.115824 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-caec684e-8039-4db4-986c-fdb38a24b8ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:07.116483 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-caec684e-8039-4db4-986c-fdb38a24b8ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:07.116937 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-caec684e-8039-4db4-986c-fdb38a24b8ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:07.117533 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-caec684e-8039-4db4-986c-fdb38a24b8ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:07.150874 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-ac0a6bd8-0524-408f-a3bc-9b31d23de33d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:07.151960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-ac0a6bd8-0524-408f-a3bc-9b31d23de33d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:07.158157 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ac0a6bd8-0524-408f-a3bc-9b31d23de33d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:07.158640 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ac0a6bd8-0524-408f-a3bc-9b31d23de33d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:07.159109 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ac0a6bd8-0524-408f-a3bc-9b31d23de33d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:07.159805 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ac0a6bd8-0524-408f-a3bc-9b31d23de33d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:07.160251 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ac0a6bd8-0524-408f-a3bc-9b31d23de33d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:07.160671 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ac0a6bd8-0524-408f-a3bc-9b31d23de33d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:07.195297 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-caec684e-8039-4db4-986c-fdb38a24b8ac tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091995 Oct 28 19:09:07.195886 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 246/474] 10.222.0.58 () {58 vars in 1275 bytes} [Fri Oct 28 19:09:07 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:09:07.333036 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ac0a6bd8-0524-408f-a3bc-9b31d23de33d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:07.344785 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ac0a6bd8-0524-408f-a3bc-9b31d23de33d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:07.346590 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ac0a6bd8-0524-408f-a3bc-9b31d23de33d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:07.347793 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-ac0a6bd8-0524-408f-a3bc-9b31d23de33d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.200885 Oct 28 19:09:07.348543 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 229/475] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:07 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:09:08.044886 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-29a32e93-cfd8-4f23-b321-6a1682e0f64c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:08.045495 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-29a32e93-cfd8-4f23-b321-6a1682e0f64c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] [instance: 41cb05e8-8ade-4928-b7c1-da54775e7a17] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:08.051417 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-29a32e93-cfd8-4f23-b321-6a1682e0f64c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.051904 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-29a32e93-cfd8-4f23-b321-6a1682e0f64c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.052332 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-29a32e93-cfd8-4f23-b321-6a1682e0f64c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.053057 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-29a32e93-cfd8-4f23-b321-6a1682e0f64c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.053505 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-29a32e93-cfd8-4f23-b321-6a1682e0f64c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.053928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-29a32e93-cfd8-4f23-b321-6a1682e0f64c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.067264 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-29a32e93-cfd8-4f23-b321-6a1682e0f64c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] HTTP exception thrown: Instance 41cb05e8-8ade-4928-b7c1-da54775e7a17 could not be found. Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-29a32e93-cfd8-4f23-b321-6a1682e0f64c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Request method failure captured: Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 HTTP/1.1 Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCiXJgGzwG2Nbn5_Ptuv1d94zPW3knPnGsJsbndGmnhsydZH5cOPBJ8ndC1XRIDtQFmzz6svv77gnYcf1Es4jOO_Fz9nun0qSTnf30lfcQHV8XZ5xVTV9prsNbH-K09IbTRbkCVuWRvEyaRVtTLxwHwU_f01yHcCZVTyid3vdlOjFVA Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: 0121d8f74bf441afb820f567988c4d97 Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-VolumesActionsTest-45974856 Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:09:08.068919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:09:08.070500 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0121d8f74bf441afb820f567988c4d97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0121d8f74bf441afb820f567988c4d97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0121d8f74bf441afb820f567988c4d97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0121d8f74bf441afb820f567988c4d97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:09:08.070500 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-VolumesActionsTest-45974856 Oct 28 19:09:08.070500 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: 0121d8f74bf441afb820f567988c4d97 Oct 28 19:09:08.070500 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-VolumesActionsTest-45974856 Oct 28 19:09:08.070500 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-VolumesActionsTest-45974856-project Oct 28 19:09:08.070500 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:09:08.070500 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:09:08.070500 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: 8c9a97e40b054a3fad1bd12e80c26708 Oct 28 19:09:08.070500 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-VolumesActionsTest-45974856-project Oct 28 19:09:08.070500 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: > Oct 28 19:09:08.070500 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Instance 41cb05e8-8ade-4928-b7c1-da54775e7a17 could not be found. Oct 28 19:09:08.070500 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'id': '41cb05e8-8ade-4928-b7c1-da54775e7a17'} Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41cb05e8-8ade-4928-b7c1-da54775e7a17 could not be found. Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:09:08.071378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:09:08.072573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:09:08.072573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:09:08.072573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:09:08.072573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:09:08.072573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:09:08.072573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:09:08.072573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:09:08.072573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41cb05e8-8ade-4928-b7c1-da54775e7a17 could not be found. Oct 28 19:09:08.072573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:09:08.072573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:08.072573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:09:08.072573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:08.072573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:08.072573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:08.072573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:09:08.072573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:09:08.072573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41cb05e8-8ade-4928-b7c1-da54775e7a17 could not be found. Oct 28 19:09:08.072573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:09:08.074267 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-29a32e93-cfd8-4f23-b321-6a1682e0f64c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] Returning 404 to user: Instance 41cb05e8-8ade-4928-b7c1-da54775e7a17 could not be found. {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:09:08.074267 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-29a32e93-cfd8-4f23-b321-6a1682e0f64c tempest-VolumesActionsTest-45974856 tempest-VolumesActionsTest-45974856-project] 10.222.0.58 "GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17" status: 404 len: 111 microversion: 2.1 time: 0.030046 Oct 28 19:09:08.074267 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 247/476] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:08 2022] GET /compute/v2.1/servers/41cb05e8-8ade-4928-b7c1-da54775e7a17 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:09:08.374033 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-19fb5ec5-6a39-4cb0-8b81-9e97088ab93f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:08.374033 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-19fb5ec5-6a39-4cb0-8b81-9e97088ab93f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:08.380765 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-19fb5ec5-6a39-4cb0-8b81-9e97088ab93f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.381247 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-19fb5ec5-6a39-4cb0-8b81-9e97088ab93f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.381685 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-19fb5ec5-6a39-4cb0-8b81-9e97088ab93f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.382966 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-19fb5ec5-6a39-4cb0-8b81-9e97088ab93f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.383448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-19fb5ec5-6a39-4cb0-8b81-9e97088ab93f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.383835 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-ce404378-1b98-4816-9cde-847962e5ea4f req-da98553b-f659-40aa-9288-eb1751b6157e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f", "tag": "92395a5b-edfc-4644-8dc9-9103854d9dac"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:08.383975 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-19fb5ec5-6a39-4cb0-8b81-9e97088ab93f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.400120 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-ce404378-1b98-4816-9cde-847962e5ea4f req-da98553b-f659-40aa-9288-eb1751b6157e service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.400845 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-ce404378-1b98-4816-9cde-847962e5ea4f req-da98553b-f659-40aa-9288-eb1751b6157e service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.401820 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-ce404378-1b98-4816-9cde-847962e5ea4f req-da98553b-f659-40aa-9288-eb1751b6157e service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.420965 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-ce404378-1b98-4816-9cde-847962e5ea4f req-da98553b-f659-40aa-9288-eb1751b6157e service nova] Creating event network-changed:92395a5b-edfc-4644-8dc9-9103854d9dac for instance 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f on hv-cinder-86236 Oct 28 19:09:08.428009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-ce404378-1b98-4816-9cde-847962e5ea4f req-da98553b-f659-40aa-9288-eb1751b6157e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049761 Oct 28 19:09:08.429250 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 248/477] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:08.573134 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-19fb5ec5-6a39-4cb0-8b81-9e97088ab93f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:08.582474 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-19fb5ec5-6a39-4cb0-8b81-9e97088ab93f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:08.589104 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-19fb5ec5-6a39-4cb0-8b81-9e97088ab93f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:08.590319 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-19fb5ec5-6a39-4cb0-8b81-9e97088ab93f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.221374 Oct 28 19:09:08.590887 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 230/478] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:08 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:08.763239 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-221ac921-e822-4fff-806c-f788536c3927 req-65b350db-00d1-4251-b51d-c2bfd15daaac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "777c1a8e-485a-4333-a800-8586cdc8746b", "name": "network-vif-plugged", "status": "completed", "tag": "63e7b2ed-34d6-4aba-a769-655ad469dbc0"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:08.775212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-221ac921-e822-4fff-806c-f788536c3927 req-65b350db-00d1-4251-b51d-c2bfd15daaac service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.775698 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-221ac921-e822-4fff-806c-f788536c3927 req-65b350db-00d1-4251-b51d-c2bfd15daaac service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.776664 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-221ac921-e822-4fff-806c-f788536c3927 req-65b350db-00d1-4251-b51d-c2bfd15daaac service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.788340 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-221ac921-e822-4fff-806c-f788536c3927 req-65b350db-00d1-4251-b51d-c2bfd15daaac service nova] Creating event network-vif-plugged:63e7b2ed-34d6-4aba-a769-655ad469dbc0 for instance 777c1a8e-485a-4333-a800-8586cdc8746b on hv-cinder-86236 Oct 28 19:09:08.796829 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-221ac921-e822-4fff-806c-f788536c3927 req-65b350db-00d1-4251-b51d-c2bfd15daaac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061063 Oct 28 19:09:08.797995 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 249/479] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:09.616790 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-207e458a-2839-478b-a812-4ce79ff45ae9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:09.617392 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-207e458a-2839-478b-a812-4ce79ff45ae9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:09.624776 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-207e458a-2839-478b-a812-4ce79ff45ae9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:09.625268 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-207e458a-2839-478b-a812-4ce79ff45ae9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:09.625716 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-207e458a-2839-478b-a812-4ce79ff45ae9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:09.626430 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-207e458a-2839-478b-a812-4ce79ff45ae9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:09.626892 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-207e458a-2839-478b-a812-4ce79ff45ae9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:09.627355 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-207e458a-2839-478b-a812-4ce79ff45ae9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:09.771406 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-207e458a-2839-478b-a812-4ce79ff45ae9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:09.780744 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-207e458a-2839-478b-a812-4ce79ff45ae9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:09.782216 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-207e458a-2839-478b-a812-4ce79ff45ae9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:09.783416 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-207e458a-2839-478b-a812-4ce79ff45ae9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.170457 Oct 28 19:09:09.784004 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 231/480] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:09 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:10.808772 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-e03dc3ab-a1b5-4e92-8091-1d226de63e90 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:10.809568 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-e03dc3ab-a1b5-4e92-8091-1d226de63e90 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:10.815708 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e03dc3ab-a1b5-4e92-8091-1d226de63e90 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:10.816181 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e03dc3ab-a1b5-4e92-8091-1d226de63e90 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:10.816612 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e03dc3ab-a1b5-4e92-8091-1d226de63e90 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:10.817287 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e03dc3ab-a1b5-4e92-8091-1d226de63e90 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:10.817731 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e03dc3ab-a1b5-4e92-8091-1d226de63e90 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:10.818150 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e03dc3ab-a1b5-4e92-8091-1d226de63e90 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:10.946394 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e03dc3ab-a1b5-4e92-8091-1d226de63e90 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:10.955333 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e03dc3ab-a1b5-4e92-8091-1d226de63e90 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:10.956859 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e03dc3ab-a1b5-4e92-8091-1d226de63e90 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:10.958078 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-e03dc3ab-a1b5-4e92-8091-1d226de63e90 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.153616 Oct 28 19:09:10.958625 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 250/481] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:10 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:11.983497 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-3f8972ef-3750-4b46-89fd-3775fdc4c3f1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:11.984167 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-3f8972ef-3750-4b46-89fd-3775fdc4c3f1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:11.986587 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:11.992905 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3f8972ef-3750-4b46-89fd-3775fdc4c3f1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:11.993394 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3f8972ef-3750-4b46-89fd-3775fdc4c3f1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:11.993836 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3f8972ef-3750-4b46-89fd-3775fdc4c3f1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:11.994546 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3f8972ef-3750-4b46-89fd-3775fdc4c3f1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:11.995031 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3f8972ef-3750-4b46-89fd-3775fdc4c3f1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:11.995461 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3f8972ef-3750-4b46-89fd-3775fdc4c3f1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:12.127277 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3f8972ef-3750-4b46-89fd-3775fdc4c3f1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:12.136287 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3f8972ef-3750-4b46-89fd-3775fdc4c3f1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:12.137760 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3f8972ef-3750-4b46-89fd-3775fdc4c3f1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:12.138942 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-3f8972ef-3750-4b46-89fd-3775fdc4c3f1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.159373 Oct 28 19:09:12.139506 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 232/482] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:11 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:12.908361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-39599c05-e64f-469e-ad6a-626474f8c642 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:12.910626 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-39599c05-e64f-469e-ad6a-626474f8c642 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:12.916660 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-39599c05-e64f-469e-ad6a-626474f8c642 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:12.917135 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-39599c05-e64f-469e-ad6a-626474f8c642 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:12.917572 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-39599c05-e64f-469e-ad6a-626474f8c642 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:12.918255 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-39599c05-e64f-469e-ad6a-626474f8c642 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:12.918706 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-39599c05-e64f-469e-ad6a-626474f8c642 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:12.919166 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-39599c05-e64f-469e-ad6a-626474f8c642 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:12.991700 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-39599c05-e64f-469e-ad6a-626474f8c642 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "POST /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c/action" status: 202 len: 0 microversion: 2.1 time: 0.086685 Oct 28 19:09:12.992802 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 251/483] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Oct 28 19:09:12 2022] POST /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:09:13.002111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-93bd449f-0bda-436d-a53c-914ece06cb6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:13.002762 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-93bd449f-0bda-436d-a53c-914ece06cb6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:13.009208 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-93bd449f-0bda-436d-a53c-914ece06cb6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:13.009689 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-93bd449f-0bda-436d-a53c-914ece06cb6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:13.010781 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-93bd449f-0bda-436d-a53c-914ece06cb6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:13.011520 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-93bd449f-0bda-436d-a53c-914ece06cb6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:13.011983 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-93bd449f-0bda-436d-a53c-914ece06cb6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:13.012413 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-93bd449f-0bda-436d-a53c-914ece06cb6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:13.161351 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-93bd449f-0bda-436d-a53c-914ece06cb6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:13.167401 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4db9753d-aff5-4eb1-ab74-745d011d1022 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:13.168266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-4db9753d-aff5-4eb1-ab74-745d011d1022 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:13.170286 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-93bd449f-0bda-436d-a53c-914ece06cb6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1749 microversion: 2.1 time: 0.172067 Oct 28 19:09:13.171023 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 233/484] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:12 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:13.178204 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4db9753d-aff5-4eb1-ab74-745d011d1022 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:13.178938 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4db9753d-aff5-4eb1-ab74-745d011d1022 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:13.179596 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4db9753d-aff5-4eb1-ab74-745d011d1022 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:13.180533 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4db9753d-aff5-4eb1-ab74-745d011d1022 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:13.181303 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4db9753d-aff5-4eb1-ab74-745d011d1022 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:13.182659 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4db9753d-aff5-4eb1-ab74-745d011d1022 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:13.360968 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4db9753d-aff5-4eb1-ab74-745d011d1022 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:13.371867 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4db9753d-aff5-4eb1-ab74-745d011d1022 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:13.373836 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4db9753d-aff5-4eb1-ab74-745d011d1022 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:13.375200 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-4db9753d-aff5-4eb1-ab74-745d011d1022 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.213207 Oct 28 19:09:13.375963 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 252/485] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:13 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:09:14.200179 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-cf8f94c4-2dcd-476c-b158-1885a8eecb31 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:14.207842 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-cf8f94c4-2dcd-476c-b158-1885a8eecb31 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:14.220512 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cf8f94c4-2dcd-476c-b158-1885a8eecb31 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:14.221354 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cf8f94c4-2dcd-476c-b158-1885a8eecb31 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:14.222014 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cf8f94c4-2dcd-476c-b158-1885a8eecb31 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:14.223292 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cf8f94c4-2dcd-476c-b158-1885a8eecb31 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:14.223958 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cf8f94c4-2dcd-476c-b158-1885a8eecb31 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:14.224682 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cf8f94c4-2dcd-476c-b158-1885a8eecb31 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:14.405126 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-cf8f94c4-2dcd-476c-b158-1885a8eecb31 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:14.405429 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-94a032cc-c9bf-4d6d-912a-0769dd7652ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:14.407125 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-94a032cc-c9bf-4d6d-912a-0769dd7652ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:14.414497 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-cf8f94c4-2dcd-476c-b158-1885a8eecb31 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1749 microversion: 2.1 time: 0.222394 Oct 28 19:09:14.414662 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-94a032cc-c9bf-4d6d-912a-0769dd7652ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:14.415017 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-94a032cc-c9bf-4d6d-912a-0769dd7652ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:14.415772 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-94a032cc-c9bf-4d6d-912a-0769dd7652ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:14.416221 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 234/486] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:14 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1749 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:14.417641 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-94a032cc-c9bf-4d6d-912a-0769dd7652ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:14.418100 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-94a032cc-c9bf-4d6d-912a-0769dd7652ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:14.418531 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-94a032cc-c9bf-4d6d-912a-0769dd7652ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:14.652643 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-94a032cc-c9bf-4d6d-912a-0769dd7652ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:14.662685 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-94a032cc-c9bf-4d6d-912a-0769dd7652ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:14.664176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-94a032cc-c9bf-4d6d-912a-0769dd7652ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:14.665751 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-94a032cc-c9bf-4d6d-912a-0769dd7652ec tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1808 microversion: 2.20 time: 0.266742 Oct 28 19:09:14.666888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 253/487] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:14 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1808 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:09:15.438566 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-74321f4f-a85f-4549-aa0b-63a24b7427a0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:15.439500 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-74321f4f-a85f-4549-aa0b-63a24b7427a0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:15.446520 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74321f4f-a85f-4549-aa0b-63a24b7427a0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:15.447161 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74321f4f-a85f-4549-aa0b-63a24b7427a0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:15.447704 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74321f4f-a85f-4549-aa0b-63a24b7427a0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:15.448514 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74321f4f-a85f-4549-aa0b-63a24b7427a0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:15.449001 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74321f4f-a85f-4549-aa0b-63a24b7427a0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:15.449441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74321f4f-a85f-4549-aa0b-63a24b7427a0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:15.621643 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-74321f4f-a85f-4549-aa0b-63a24b7427a0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:15.630054 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-74321f4f-a85f-4549-aa0b-63a24b7427a0 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1754 microversion: 2.1 time: 0.195613 Oct 28 19:09:15.630674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 235/488] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:15 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1754 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:15.692151 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-debc9d08-b71b-4712-8d65-a7eb8e5d4f3d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:15.693949 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-debc9d08-b71b-4712-8d65-a7eb8e5d4f3d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:15.701598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-debc9d08-b71b-4712-8d65-a7eb8e5d4f3d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:15.702240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-debc9d08-b71b-4712-8d65-a7eb8e5d4f3d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:15.702797 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-debc9d08-b71b-4712-8d65-a7eb8e5d4f3d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:15.703779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-debc9d08-b71b-4712-8d65-a7eb8e5d4f3d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:15.704576 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-debc9d08-b71b-4712-8d65-a7eb8e5d4f3d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:15.705358 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-debc9d08-b71b-4712-8d65-a7eb8e5d4f3d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:15.860615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-debc9d08-b71b-4712-8d65-a7eb8e5d4f3d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:15.872385 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-debc9d08-b71b-4712-8d65-a7eb8e5d4f3d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:15.873777 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-debc9d08-b71b-4712-8d65-a7eb8e5d4f3d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:15.874962 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-debc9d08-b71b-4712-8d65-a7eb8e5d4f3d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1795 microversion: 2.20 time: 0.187840 Oct 28 19:09:15.875702 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 254/489] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:15 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1795 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:16.657845 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-fa957ad4-2a2e-41cf-b599-716e2d45f87a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:16.658462 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-fa957ad4-2a2e-41cf-b599-716e2d45f87a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:16.665771 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fa957ad4-2a2e-41cf-b599-716e2d45f87a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:16.666773 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fa957ad4-2a2e-41cf-b599-716e2d45f87a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:16.667425 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fa957ad4-2a2e-41cf-b599-716e2d45f87a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:16.668141 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fa957ad4-2a2e-41cf-b599-716e2d45f87a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:16.668674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fa957ad4-2a2e-41cf-b599-716e2d45f87a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:16.669037 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fa957ad4-2a2e-41cf-b599-716e2d45f87a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:16.688600 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=100 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:16.852384 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-fa957ad4-2a2e-41cf-b599-716e2d45f87a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:16.861663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-fa957ad4-2a2e-41cf-b599-716e2d45f87a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1754 microversion: 2.1 time: 0.208179 Oct 28 19:09:16.862256 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 236/490] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:16 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1754 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:17.886245 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-5bb49e87-2cab-4be9-a028-82a8053fca93 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:17.886863 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-5bb49e87-2cab-4be9-a028-82a8053fca93 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:17.893072 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5bb49e87-2cab-4be9-a028-82a8053fca93 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:17.893769 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5bb49e87-2cab-4be9-a028-82a8053fca93 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:17.894205 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5bb49e87-2cab-4be9-a028-82a8053fca93 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:17.894897 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5bb49e87-2cab-4be9-a028-82a8053fca93 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:17.895369 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5bb49e87-2cab-4be9-a028-82a8053fca93 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:17.895815 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5bb49e87-2cab-4be9-a028-82a8053fca93 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:18.061391 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-5bb49e87-2cab-4be9-a028-82a8053fca93 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:18.065767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:18.077043 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-5bb49e87-2cab-4be9-a028-82a8053fca93 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1754 microversion: 2.1 time: 0.195570 Oct 28 19:09:18.077720 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 255/491] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:17 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1754 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:19.101990 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-ff25d376-b8e7-4a2a-90a4-daadbbfcc918 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:19.102611 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-ff25d376-b8e7-4a2a-90a4-daadbbfcc918 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:19.109289 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ff25d376-b8e7-4a2a-90a4-daadbbfcc918 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:19.109959 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ff25d376-b8e7-4a2a-90a4-daadbbfcc918 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:19.110405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ff25d376-b8e7-4a2a-90a4-daadbbfcc918 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:19.111239 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ff25d376-b8e7-4a2a-90a4-daadbbfcc918 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:19.111887 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ff25d376-b8e7-4a2a-90a4-daadbbfcc918 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:19.112327 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ff25d376-b8e7-4a2a-90a4-daadbbfcc918 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:19.278782 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ff25d376-b8e7-4a2a-90a4-daadbbfcc918 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:19.289641 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-ff25d376-b8e7-4a2a-90a4-daadbbfcc918 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1754 microversion: 2.1 time: 0.191573 Oct 28 19:09:19.290235 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 237/492] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:19 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1754 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:20.316116 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-be88bac7-9545-4641-a35c-ec28b7a0191f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:20.317746 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-be88bac7-9545-4641-a35c-ec28b7a0191f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:20.321108 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:09:20.321285 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Fri Oct 28 19:09:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c (ip 10.222.0.58) !!! Oct 28 19:09:20.337462 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-be88bac7-9545-4641-a35c-ec28b7a0191f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:20.338096 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-be88bac7-9545-4641-a35c-ec28b7a0191f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:20.338671 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-be88bac7-9545-4641-a35c-ec28b7a0191f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:20.339679 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-be88bac7-9545-4641-a35c-ec28b7a0191f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:20.340287 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-be88bac7-9545-4641-a35c-ec28b7a0191f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:20.340847 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-be88bac7-9545-4641-a35c-ec28b7a0191f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:20.507279 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-be88bac7-9545-4641-a35c-ec28b7a0191f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:20.517566 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-be88bac7-9545-4641-a35c-ec28b7a0191f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1754 microversion: 2.1 time: 0.207047 Oct 28 19:09:20.519129 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 256/493] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:20 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1754 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:21.542696 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-eec9fc09-7ee4-44c2-9d2e-5e5fbef3c6dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:21.543319 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-eec9fc09-7ee4-44c2-9d2e-5e5fbef3c6dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:21.550359 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eec9fc09-7ee4-44c2-9d2e-5e5fbef3c6dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:21.550823 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eec9fc09-7ee4-44c2-9d2e-5e5fbef3c6dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:21.551292 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eec9fc09-7ee4-44c2-9d2e-5e5fbef3c6dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:21.552001 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eec9fc09-7ee4-44c2-9d2e-5e5fbef3c6dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:21.552452 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eec9fc09-7ee4-44c2-9d2e-5e5fbef3c6dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:21.552875 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-eec9fc09-7ee4-44c2-9d2e-5e5fbef3c6dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:21.710245 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-eec9fc09-7ee4-44c2-9d2e-5e5fbef3c6dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:21.719457 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-eec9fc09-7ee4-44c2-9d2e-5e5fbef3c6dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1754 microversion: 2.1 time: 0.181331 Oct 28 19:09:21.720214 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 238/494] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:21 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1754 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:22.741755 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-949fbf42-d77d-496b-a2f6-3ff4e242507d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:22.742294 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-949fbf42-d77d-496b-a2f6-3ff4e242507d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:22.751269 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-949fbf42-d77d-496b-a2f6-3ff4e242507d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:22.751269 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-949fbf42-d77d-496b-a2f6-3ff4e242507d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:22.751269 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-949fbf42-d77d-496b-a2f6-3ff4e242507d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:22.751269 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-949fbf42-d77d-496b-a2f6-3ff4e242507d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:22.751727 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-949fbf42-d77d-496b-a2f6-3ff4e242507d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:22.751727 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-949fbf42-d77d-496b-a2f6-3ff4e242507d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:22.907683 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-949fbf42-d77d-496b-a2f6-3ff4e242507d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:22.917303 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-949fbf42-d77d-496b-a2f6-3ff4e242507d tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1754 microversion: 2.1 time: 0.179556 Oct 28 19:09:22.918645 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 257/495] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:22 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:23.941877 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-791fed9f-c2f0-428b-8cde-b8d50f67467f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:23.942515 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-791fed9f-c2f0-428b-8cde-b8d50f67467f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:23.949707 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-791fed9f-c2f0-428b-8cde-b8d50f67467f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:23.950281 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-791fed9f-c2f0-428b-8cde-b8d50f67467f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:23.950819 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-791fed9f-c2f0-428b-8cde-b8d50f67467f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:23.951637 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-791fed9f-c2f0-428b-8cde-b8d50f67467f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:23.952175 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-791fed9f-c2f0-428b-8cde-b8d50f67467f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:23.952682 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-791fed9f-c2f0-428b-8cde-b8d50f67467f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:24.118429 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-791fed9f-c2f0-428b-8cde-b8d50f67467f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:24.127510 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-791fed9f-c2f0-428b-8cde-b8d50f67467f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1754 microversion: 2.1 time: 0.189462 Oct 28 19:09:24.143587 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 239/496] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:23 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1754 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:25.152427 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f671ecd8-cf96-42d1-92ee-64936ca2abe3 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:25.153013 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f671ecd8-cf96-42d1-92ee-64936ca2abe3 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:25.159126 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f671ecd8-cf96-42d1-92ee-64936ca2abe3 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:25.159596 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f671ecd8-cf96-42d1-92ee-64936ca2abe3 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:25.160021 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f671ecd8-cf96-42d1-92ee-64936ca2abe3 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:25.160719 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f671ecd8-cf96-42d1-92ee-64936ca2abe3 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:25.161167 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f671ecd8-cf96-42d1-92ee-64936ca2abe3 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:25.161586 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f671ecd8-cf96-42d1-92ee-64936ca2abe3 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:25.333551 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f671ecd8-cf96-42d1-92ee-64936ca2abe3 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:25.342514 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f671ecd8-cf96-42d1-92ee-64936ca2abe3 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1754 microversion: 2.1 time: 0.194273 Oct 28 19:09:25.343116 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 258/497] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:25 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1754 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:26.371528 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-cf68d5eb-185a-48ee-aa5e-b5ede7241441 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:26.373200 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-cf68d5eb-185a-48ee-aa5e-b5ede7241441 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:26.381858 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cf68d5eb-185a-48ee-aa5e-b5ede7241441 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:26.381858 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cf68d5eb-185a-48ee-aa5e-b5ede7241441 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:26.381858 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cf68d5eb-185a-48ee-aa5e-b5ede7241441 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:26.382282 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cf68d5eb-185a-48ee-aa5e-b5ede7241441 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:26.383444 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cf68d5eb-185a-48ee-aa5e-b5ede7241441 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:26.384355 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cf68d5eb-185a-48ee-aa5e-b5ede7241441 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:26.575789 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-cf68d5eb-185a-48ee-aa5e-b5ede7241441 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:26.584637 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-cf68d5eb-185a-48ee-aa5e-b5ede7241441 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1754 microversion: 2.1 time: 0.219132 Oct 28 19:09:26.585273 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 240/498] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:26 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1754 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:27.609735 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-da4dbbb2-f35e-4215-bd06-6e9c2eb7b21f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:27.611071 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-da4dbbb2-f35e-4215-bd06-6e9c2eb7b21f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:27.617658 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-da4dbbb2-f35e-4215-bd06-6e9c2eb7b21f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:27.618458 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-da4dbbb2-f35e-4215-bd06-6e9c2eb7b21f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:27.619686 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-da4dbbb2-f35e-4215-bd06-6e9c2eb7b21f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:27.620397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-da4dbbb2-f35e-4215-bd06-6e9c2eb7b21f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:27.620850 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-da4dbbb2-f35e-4215-bd06-6e9c2eb7b21f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:27.621278 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-da4dbbb2-f35e-4215-bd06-6e9c2eb7b21f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:27.781759 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-da4dbbb2-f35e-4215-bd06-6e9c2eb7b21f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:27.790170 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-da4dbbb2-f35e-4215-bd06-6e9c2eb7b21f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1754 microversion: 2.1 time: 0.184401 Oct 28 19:09:27.791507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 259/499] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:27 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:28.814719 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-44956b1e-8a4e-4978-ba1f-11b2c5fc6a10 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:28.815365 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-44956b1e-8a4e-4978-ba1f-11b2c5fc6a10 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:28.821657 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-44956b1e-8a4e-4978-ba1f-11b2c5fc6a10 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:28.822197 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-44956b1e-8a4e-4978-ba1f-11b2c5fc6a10 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:28.822638 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-44956b1e-8a4e-4978-ba1f-11b2c5fc6a10 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:28.823364 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-44956b1e-8a4e-4978-ba1f-11b2c5fc6a10 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:28.823842 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-44956b1e-8a4e-4978-ba1f-11b2c5fc6a10 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:28.824243 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-44956b1e-8a4e-4978-ba1f-11b2c5fc6a10 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:28.970463 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-44956b1e-8a4e-4978-ba1f-11b2c5fc6a10 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:28.979907 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-44956b1e-8a4e-4978-ba1f-11b2c5fc6a10 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1754 microversion: 2.1 time: 0.168963 Oct 28 19:09:28.980534 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 241/500] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:28 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:30.005027 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-55305d2c-cb9a-4da5-b7d6-36447977c55a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:30.006074 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-55305d2c-cb9a-4da5-b7d6-36447977c55a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:30.013718 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-55305d2c-cb9a-4da5-b7d6-36447977c55a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:30.014199 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-55305d2c-cb9a-4da5-b7d6-36447977c55a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:30.014634 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-55305d2c-cb9a-4da5-b7d6-36447977c55a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:30.015347 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-55305d2c-cb9a-4da5-b7d6-36447977c55a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:30.015801 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-55305d2c-cb9a-4da5-b7d6-36447977c55a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:30.016225 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-55305d2c-cb9a-4da5-b7d6-36447977c55a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:30.156775 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-55305d2c-cb9a-4da5-b7d6-36447977c55a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:30.164883 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-55305d2c-cb9a-4da5-b7d6-36447977c55a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1754 microversion: 2.1 time: 0.166155 Oct 28 19:09:30.165444 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 260/501] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:29 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:31.188631 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-6027a29e-20df-4cbd-81a3-36ff855da16a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:31.189249 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-6027a29e-20df-4cbd-81a3-36ff855da16a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:31.195849 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6027a29e-20df-4cbd-81a3-36ff855da16a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:31.196338 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6027a29e-20df-4cbd-81a3-36ff855da16a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:31.197360 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6027a29e-20df-4cbd-81a3-36ff855da16a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:31.198064 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6027a29e-20df-4cbd-81a3-36ff855da16a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:31.198580 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6027a29e-20df-4cbd-81a3-36ff855da16a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:31.199080 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6027a29e-20df-4cbd-81a3-36ff855da16a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:31.381766 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-6027a29e-20df-4cbd-81a3-36ff855da16a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:31.391288 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-6027a29e-20df-4cbd-81a3-36ff855da16a tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1754 microversion: 2.1 time: 0.206492 Oct 28 19:09:31.392141 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 242/502] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:31 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1754 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:32.420461 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-e90c217e-dff7-4fcd-81e6-b087f55bf6a5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:32.421057 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-e90c217e-dff7-4fcd-81e6-b087f55bf6a5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:32.422910 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=47 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:32.428426 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e90c217e-dff7-4fcd-81e6-b087f55bf6a5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.428902 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e90c217e-dff7-4fcd-81e6-b087f55bf6a5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.429330 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e90c217e-dff7-4fcd-81e6-b087f55bf6a5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.430013 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e90c217e-dff7-4fcd-81e6-b087f55bf6a5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.430458 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e90c217e-dff7-4fcd-81e6-b087f55bf6a5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.430876 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e90c217e-dff7-4fcd-81e6-b087f55bf6a5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.584548 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e90c217e-dff7-4fcd-81e6-b087f55bf6a5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:32.593743 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-e90c217e-dff7-4fcd-81e6-b087f55bf6a5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1754 microversion: 2.1 time: 0.177066 Oct 28 19:09:32.594314 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 261/503] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:32 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:33.617640 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-1e3fac8f-b001-4de7-888c-a6479c210e20 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:33.618249 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-1e3fac8f-b001-4de7-888c-a6479c210e20 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:33.625287 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1e3fac8f-b001-4de7-888c-a6479c210e20 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:33.625771 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1e3fac8f-b001-4de7-888c-a6479c210e20 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:33.626302 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1e3fac8f-b001-4de7-888c-a6479c210e20 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:33.627014 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1e3fac8f-b001-4de7-888c-a6479c210e20 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:33.627470 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1e3fac8f-b001-4de7-888c-a6479c210e20 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:33.627899 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1e3fac8f-b001-4de7-888c-a6479c210e20 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:33.775778 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1e3fac8f-b001-4de7-888c-a6479c210e20 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:33.783975 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-1e3fac8f-b001-4de7-888c-a6479c210e20 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1754 microversion: 2.1 time: 0.170219 Oct 28 19:09:33.784546 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 243/504] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:33 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:34.807981 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-8ef88b0f-e5af-40c5-9915-de6134f96d59 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:34.808604 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-8ef88b0f-e5af-40c5-9915-de6134f96d59 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:34.814511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8ef88b0f-e5af-40c5-9915-de6134f96d59 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:34.815000 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8ef88b0f-e5af-40c5-9915-de6134f96d59 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:34.815462 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8ef88b0f-e5af-40c5-9915-de6134f96d59 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:34.816146 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8ef88b0f-e5af-40c5-9915-de6134f96d59 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:34.816598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8ef88b0f-e5af-40c5-9915-de6134f96d59 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:34.817022 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8ef88b0f-e5af-40c5-9915-de6134f96d59 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:34.961530 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-8ef88b0f-e5af-40c5-9915-de6134f96d59 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:34.969746 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-8ef88b0f-e5af-40c5-9915-de6134f96d59 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1754 microversion: 2.1 time: 0.166183 Oct 28 19:09:34.970314 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 262/505] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:34 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:35.993605 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d27e7be7-e4e7-4fc8-9dca-2e3b980d6d6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:35.994299 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d27e7be7-e4e7-4fc8-9dca-2e3b980d6d6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:36.002128 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d27e7be7-e4e7-4fc8-9dca-2e3b980d6d6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:36.002623 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d27e7be7-e4e7-4fc8-9dca-2e3b980d6d6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:36.003103 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d27e7be7-e4e7-4fc8-9dca-2e3b980d6d6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:36.003818 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d27e7be7-e4e7-4fc8-9dca-2e3b980d6d6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:36.004276 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d27e7be7-e4e7-4fc8-9dca-2e3b980d6d6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:36.004708 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d27e7be7-e4e7-4fc8-9dca-2e3b980d6d6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:36.155708 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d27e7be7-e4e7-4fc8-9dca-2e3b980d6d6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:36.164229 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d27e7be7-e4e7-4fc8-9dca-2e3b980d6d6f tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1754 microversion: 2.1 time: 0.175264 Oct 28 19:09:36.164798 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 244/506] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:35 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:37.188129 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-0ad2bff0-cf99-4aa4-8080-b697ffb732e7 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:37.188735 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-0ad2bff0-cf99-4aa4-8080-b697ffb732e7 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:37.194788 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0ad2bff0-cf99-4aa4-8080-b697ffb732e7 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:37.195301 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0ad2bff0-cf99-4aa4-8080-b697ffb732e7 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:37.195741 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0ad2bff0-cf99-4aa4-8080-b697ffb732e7 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:37.196430 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0ad2bff0-cf99-4aa4-8080-b697ffb732e7 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:37.196883 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0ad2bff0-cf99-4aa4-8080-b697ffb732e7 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:37.197313 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0ad2bff0-cf99-4aa4-8080-b697ffb732e7 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:37.343462 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-0ad2bff0-cf99-4aa4-8080-b697ffb732e7 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:37.351862 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-0ad2bff0-cf99-4aa4-8080-b697ffb732e7 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1757 microversion: 2.1 time: 0.167659 Oct 28 19:09:37.352431 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 263/507] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:37 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:55.731304 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-4c3381ac-8fd5-45c2-83a7-e59000e2639d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5856a454-f918-4084-8635-e661ad162b63"}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:55.733717 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-4c3381ac-8fd5-45c2-83a7-e59000e2639d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:55.736286 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_api:SELECT=25 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:55.737136 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=50 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:55.742829 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4c3381ac-8fd5-45c2-83a7-e59000e2639d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:55.743340 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4c3381ac-8fd5-45c2-83a7-e59000e2639d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:55.743783 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4c3381ac-8fd5-45c2-83a7-e59000e2639d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:55.744480 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4c3381ac-8fd5-45c2-83a7-e59000e2639d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:55.744941 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4c3381ac-8fd5-45c2-83a7-e59000e2639d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:55.745376 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4c3381ac-8fd5-45c2-83a7-e59000e2639d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:56.006901 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-4c3381ac-8fd5-45c2-83a7-e59000e2639d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "POST /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279480 Oct 28 19:09:56.007567 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 245/508] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Oct 28 19:09:55 2022] POST /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:02.626205 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-b08ef2e2-6faf-442f-8dcd-cc3a596d40b7 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-38857208", "imageRef": "cd92a575-ed0d-417b-b416-3471be3ba100", "flavorRef": "452"}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:02.633496 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=5 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:02.634153 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=48 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:02.681130 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.network.neutron [None req-b08ef2e2-6faf-442f-8dcd-cc3a596d40b7 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] validate_networks() for None {{(pid=118874) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:10:02.945139 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-b08ef2e2-6faf-442f-8dcd-cc3a596d40b7 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Flavor limits 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:10:02.945575 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-b08ef2e2-6faf-442f-8dcd-cc3a596d40b7 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Image limits 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:10:02.946030 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-b08ef2e2-6faf-442f-8dcd-cc3a596d40b7 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Flavor pref 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:10:02.946475 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-b08ef2e2-6faf-442f-8dcd-cc3a596d40b7 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Image pref 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:10:02.946876 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-b08ef2e2-6faf-442f-8dcd-cc3a596d40b7 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:10:02.956007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b08ef2e2-6faf-442f-8dcd-cc3a596d40b7 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:02.956490 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b08ef2e2-6faf-442f-8dcd-cc3a596d40b7 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:02.956926 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b08ef2e2-6faf-442f-8dcd-cc3a596d40b7 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:02.957656 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b08ef2e2-6faf-442f-8dcd-cc3a596d40b7 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:02.958945 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b08ef2e2-6faf-442f-8dcd-cc3a596d40b7 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:02.959448 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b08ef2e2-6faf-442f-8dcd-cc3a596d40b7 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:02.977083 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-b08ef2e2-6faf-442f-8dcd-cc3a596d40b7 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Getting quotas for project bbac7c759b264dba88f7cb7b899cd360. Resources: {'ram', 'instances', 'cores'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:10:02.981155 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-b08ef2e2-6faf-442f-8dcd-cc3a596d40b7 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Getting quotas for user 91d69e5a88004926904fd83cd63cc61b and project bbac7c759b264dba88f7cb7b899cd360. Resources: {'ram', 'instances', 'cores'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:10:02.993034 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-b08ef2e2-6faf-442f-8dcd-cc3a596d40b7 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Going to run 1 instances... {{(pid=118874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:10:02.995354 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-b08ef2e2-6faf-442f-8dcd-cc3a596d40b7 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd92a575-ed0d-417b-b416-3471be3ba100',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:10:03.039870 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-b08ef2e2-6faf-442f-8dcd-cc3a596d40b7 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.418260 Oct 28 19:10:03.040522 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 264/509] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Oct 28 19:10:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:10:03.052978 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-0b94ca0a-b488-435b-876b-52865b524217 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:03.053675 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-0b94ca0a-b488-435b-876b-52865b524217 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:03.112092 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-0b94ca0a-b488-435b-876b-52865b524217 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:03.119033 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-0b94ca0a-b488-435b-876b-52865b524217 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1213 microversion: 2.1 time: 0.070692 Oct 28 19:10:03.119603 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 246/510] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:03 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:03.935680 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-35e495a9-455b-4e86-a74c-c07ee867858e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:03.936248 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-35e495a9-455b-4e86-a74c-c07ee867858e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:03.942616 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-35e495a9-455b-4e86-a74c-c07ee867858e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:03.943132 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-35e495a9-455b-4e86-a74c-c07ee867858e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:03.943572 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-35e495a9-455b-4e86-a74c-c07ee867858e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:03.944253 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-35e495a9-455b-4e86-a74c-c07ee867858e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:03.944704 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-35e495a9-455b-4e86-a74c-c07ee867858e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:03.945159 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-35e495a9-455b-4e86-a74c-c07ee867858e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:03.976178 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-35e495a9-455b-4e86-a74c-c07ee867858e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments/bffc40a0-af8a-479d-8616-8c15bd0780fa" status: 200 len: 194 microversion: 2.20 time: 0.044621 Oct 28 19:10:03.976744 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 265/511] 10.222.0.58 () {60 vars in 1454 bytes} [Fri Oct 28 19:10:03 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments/bffc40a0-af8a-479d-8616-8c15bd0780fa => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:10:04.044625 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-56d98220-7c37-45af-a9d5-dbf168ce32db tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:04.045152 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-56d98220-7c37-45af-a9d5-dbf168ce32db tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:04.052244 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-56d98220-7c37-45af-a9d5-dbf168ce32db tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:04.052722 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-56d98220-7c37-45af-a9d5-dbf168ce32db tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:04.053155 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-56d98220-7c37-45af-a9d5-dbf168ce32db tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:04.053848 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-56d98220-7c37-45af-a9d5-dbf168ce32db tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:04.054281 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-56d98220-7c37-45af-a9d5-dbf168ce32db tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:04.054704 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-56d98220-7c37-45af-a9d5-dbf168ce32db tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:04.142120 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4813f5d1-0d50-4e6c-b579-bdb3a3a3f891 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:04.142668 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-4813f5d1-0d50-4e6c-b579-bdb3a3a3f891 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:04.150970 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4813f5d1-0d50-4e6c-b579-bdb3a3a3f891 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:04.151851 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4813f5d1-0d50-4e6c-b579-bdb3a3a3f891 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:04.152641 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4813f5d1-0d50-4e6c-b579-bdb3a3a3f891 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:04.153869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4813f5d1-0d50-4e6c-b579-bdb3a3a3f891 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:04.154669 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4813f5d1-0d50-4e6c-b579-bdb3a3a3f891 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:04.155323 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4813f5d1-0d50-4e6c-b579-bdb3a3a3f891 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:04.178775 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.objects.instance [None req-56d98220-7c37-45af-a9d5-dbf168ce32db tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lazy-loading 'services' on Instance uuid 777c1a8e-485a-4333-a800-8586cdc8746b {{(pid=118875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:04.215869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4813f5d1-0d50-4e6c-b579-bdb3a3a3f891 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:04.223308 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-4813f5d1-0d50-4e6c-b579-bdb3a3a3f891 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1217 microversion: 2.1 time: 0.085643 Oct 28 19:10:04.223869 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 266/512] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:04 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:04.291300 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-56d98220-7c37-45af-a9d5-dbf168ce32db tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "DELETE /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments/bffc40a0-af8a-479d-8616-8c15bd0780fa" status: 202 len: 0 microversion: 2.20 time: 0.250330 Oct 28 19:10:04.291918 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 247/513] 10.222.0.58 () {60 vars in 1457 bytes} [Fri Oct 28 19:10:04 2022] DELETE /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments/bffc40a0-af8a-479d-8616-8c15bd0780fa => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:10:04.300867 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-586506db-76fb-4b9c-bfb7-a78f3414a09b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:04.303130 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-586506db-76fb-4b9c-bfb7-a78f3414a09b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:04.308982 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-586506db-76fb-4b9c-bfb7-a78f3414a09b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:04.309460 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-586506db-76fb-4b9c-bfb7-a78f3414a09b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:04.309895 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-586506db-76fb-4b9c-bfb7-a78f3414a09b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:04.310577 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-586506db-76fb-4b9c-bfb7-a78f3414a09b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:04.311059 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-586506db-76fb-4b9c-bfb7-a78f3414a09b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:04.312112 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-586506db-76fb-4b9c-bfb7-a78f3414a09b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:04.340336 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-586506db-76fb-4b9c-bfb7-a78f3414a09b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043438 Oct 28 19:10:04.340886 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 267/514] 10.222.0.58 () {60 vars in 1343 bytes} [Fri Oct 28 19:10:04 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:10:05.248456 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-43ab77fc-fac2-4b44-a7e6-baeb9bc5d5d3 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:05.249179 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-43ab77fc-fac2-4b44-a7e6-baeb9bc5d5d3 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:05.255843 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-43ab77fc-fac2-4b44-a7e6-baeb9bc5d5d3 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:05.256329 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-43ab77fc-fac2-4b44-a7e6-baeb9bc5d5d3 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:05.256772 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-43ab77fc-fac2-4b44-a7e6-baeb9bc5d5d3 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:05.257466 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-43ab77fc-fac2-4b44-a7e6-baeb9bc5d5d3 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:05.257922 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-43ab77fc-fac2-4b44-a7e6-baeb9bc5d5d3 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:05.258348 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-43ab77fc-fac2-4b44-a7e6-baeb9bc5d5d3 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:05.316337 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-2457594f-e7e1-48ba-8759-ca359fb645e1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:05.316935 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-2457594f-e7e1-48ba-8759-ca359fb645e1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:05.319034 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-43ab77fc-fac2-4b44-a7e6-baeb9bc5d5d3 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:05.322788 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2457594f-e7e1-48ba-8759-ca359fb645e1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:05.323297 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2457594f-e7e1-48ba-8759-ca359fb645e1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:05.323732 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2457594f-e7e1-48ba-8759-ca359fb645e1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:05.324421 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2457594f-e7e1-48ba-8759-ca359fb645e1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:05.324866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2457594f-e7e1-48ba-8759-ca359fb645e1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:05.325285 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2457594f-e7e1-48ba-8759-ca359fb645e1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:05.326517 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-43ab77fc-fac2-4b44-a7e6-baeb9bc5d5d3 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1217 microversion: 2.1 time: 0.082312 Oct 28 19:10:05.327690 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 248/515] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:05 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:05.352911 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-67d39be7-5fa4-47ff-9b6a-751a5b41f211 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:05.355186 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-67d39be7-5fa4-47ff-9b6a-751a5b41f211 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:05.361042 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-67d39be7-5fa4-47ff-9b6a-751a5b41f211 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:05.361528 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-67d39be7-5fa4-47ff-9b6a-751a5b41f211 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:05.361973 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-67d39be7-5fa4-47ff-9b6a-751a5b41f211 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:05.362673 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-67d39be7-5fa4-47ff-9b6a-751a5b41f211 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:05.363159 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-67d39be7-5fa4-47ff-9b6a-751a5b41f211 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:05.363594 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-67d39be7-5fa4-47ff-9b6a-751a5b41f211 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:05.393736 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-67d39be7-5fa4-47ff-9b6a-751a5b41f211 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044721 Oct 28 19:10:05.394314 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 249/516] 10.222.0.58 () {60 vars in 1343 bytes} [Fri Oct 28 19:10:05 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:10:05.447401 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.objects.instance [None req-2457594f-e7e1-48ba-8759-ca359fb645e1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lazy-loading 'services' on Instance uuid 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f {{(pid=118874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:05.564173 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-2457594f-e7e1-48ba-8759-ca359fb645e1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "DELETE /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/os-volume_attachments/5c578475-c4ec-47e7-babf-e13c3f4876e7" status: 202 len: 0 microversion: 2.1 time: 0.252145 Oct 28 19:10:05.564740 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 268/517] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Oct 28 19:10:05 2022] DELETE /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/os-volume_attachments/5c578475-c4ec-47e7-babf-e13c3f4876e7 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:10:06.349650 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-35670efa-99b3-44e7-8cd4-7fae113d7573 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:06.350294 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-35670efa-99b3-44e7-8cd4-7fae113d7573 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:06.356839 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-35670efa-99b3-44e7-8cd4-7fae113d7573 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:06.357326 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-35670efa-99b3-44e7-8cd4-7fae113d7573 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:06.357764 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-35670efa-99b3-44e7-8cd4-7fae113d7573 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:06.358461 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-35670efa-99b3-44e7-8cd4-7fae113d7573 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:06.358919 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-35670efa-99b3-44e7-8cd4-7fae113d7573 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:06.359377 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-35670efa-99b3-44e7-8cd4-7fae113d7573 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:06.406783 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-c2892747-c2d5-4fdc-888b-bf4f78061163 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:06.409184 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-c2892747-c2d5-4fdc-888b-bf4f78061163 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:06.415351 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c2892747-c2d5-4fdc-888b-bf4f78061163 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:06.415822 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c2892747-c2d5-4fdc-888b-bf4f78061163 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:06.416255 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c2892747-c2d5-4fdc-888b-bf4f78061163 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:06.417070 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c2892747-c2d5-4fdc-888b-bf4f78061163 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:06.417362 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c2892747-c2d5-4fdc-888b-bf4f78061163 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:06.417776 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c2892747-c2d5-4fdc-888b-bf4f78061163 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:06.419075 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-35670efa-99b3-44e7-8cd4-7fae113d7573 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:06.427140 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-35670efa-99b3-44e7-8cd4-7fae113d7573 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1217 microversion: 2.1 time: 0.081429 Oct 28 19:10:06.427717 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 250/518] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:06 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:06.448517 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-c2892747-c2d5-4fdc-888b-bf4f78061163 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046120 Oct 28 19:10:06.449061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 269/519] 10.222.0.58 () {60 vars in 1343 bytes} [Fri Oct 28 19:10:06 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:10:07.450737 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-ef1b38b0-827a-42c4-9107-98a6ac044616 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:07.451368 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-ef1b38b0-827a-42c4-9107-98a6ac044616 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:07.457855 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ef1b38b0-827a-42c4-9107-98a6ac044616 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:07.458341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ef1b38b0-827a-42c4-9107-98a6ac044616 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:07.458782 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ef1b38b0-827a-42c4-9107-98a6ac044616 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:07.459501 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ef1b38b0-827a-42c4-9107-98a6ac044616 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:07.459957 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ef1b38b0-827a-42c4-9107-98a6ac044616 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:07.460386 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ef1b38b0-827a-42c4-9107-98a6ac044616 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:07.461736 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-436ff23f-5289-4afb-8113-64b68e6511a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:07.463903 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-436ff23f-5289-4afb-8113-64b68e6511a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:07.469795 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-436ff23f-5289-4afb-8113-64b68e6511a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:07.470280 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-436ff23f-5289-4afb-8113-64b68e6511a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:07.470723 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-436ff23f-5289-4afb-8113-64b68e6511a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:07.471444 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-436ff23f-5289-4afb-8113-64b68e6511a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:07.471897 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-436ff23f-5289-4afb-8113-64b68e6511a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:07.472320 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-436ff23f-5289-4afb-8113-64b68e6511a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:07.502063 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-436ff23f-5289-4afb-8113-64b68e6511a0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044306 Oct 28 19:10:07.502637 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 270/520] 10.222.0.58 () {60 vars in 1343 bytes} [Fri Oct 28 19:10:07 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:10:07.523749 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ef1b38b0-827a-42c4-9107-98a6ac044616 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:07.531816 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-ef1b38b0-827a-42c4-9107-98a6ac044616 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1217 microversion: 2.1 time: 0.084424 Oct 28 19:10:07.532387 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 251/521] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:07 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:08.514876 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a23463d5-93a1-4fa4-901b-3fdfef12f8d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:08.517590 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-a23463d5-93a1-4fa4-901b-3fdfef12f8d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:08.523523 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a23463d5-93a1-4fa4-901b-3fdfef12f8d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:08.523996 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a23463d5-93a1-4fa4-901b-3fdfef12f8d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:08.524424 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a23463d5-93a1-4fa4-901b-3fdfef12f8d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:08.525108 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a23463d5-93a1-4fa4-901b-3fdfef12f8d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:08.525558 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a23463d5-93a1-4fa4-901b-3fdfef12f8d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:08.525976 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a23463d5-93a1-4fa4-901b-3fdfef12f8d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:08.554584 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-5a7ae416-3094-41c8-bdfc-a5468722fb5c tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:08.555123 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-a23463d5-93a1-4fa4-901b-3fdfef12f8d7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044053 Oct 28 19:10:08.555259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-5a7ae416-3094-41c8-bdfc-a5468722fb5c tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:08.555518 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 271/522] 10.222.0.58 () {60 vars in 1343 bytes} [Fri Oct 28 19:10:08 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:10:08.561516 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5a7ae416-3094-41c8-bdfc-a5468722fb5c tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:08.561998 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5a7ae416-3094-41c8-bdfc-a5468722fb5c tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:08.562953 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5a7ae416-3094-41c8-bdfc-a5468722fb5c tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:08.563671 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5a7ae416-3094-41c8-bdfc-a5468722fb5c tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:08.564120 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5a7ae416-3094-41c8-bdfc-a5468722fb5c tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:08.564544 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5a7ae416-3094-41c8-bdfc-a5468722fb5c tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:08.623891 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-5a7ae416-3094-41c8-bdfc-a5468722fb5c tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:08.631904 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-5a7ae416-3094-41c8-bdfc-a5468722fb5c tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1217 microversion: 2.1 time: 0.081176 Oct 28 19:10:08.632464 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 252/523] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:08 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:09.566956 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-c09fda27-12ce-41cc-873e-a43d3c86377b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:09.569142 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-c09fda27-12ce-41cc-873e-a43d3c86377b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:09.575348 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c09fda27-12ce-41cc-873e-a43d3c86377b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:09.575820 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c09fda27-12ce-41cc-873e-a43d3c86377b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:09.576530 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c09fda27-12ce-41cc-873e-a43d3c86377b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:09.577309 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c09fda27-12ce-41cc-873e-a43d3c86377b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:09.577755 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c09fda27-12ce-41cc-873e-a43d3c86377b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:09.578736 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c09fda27-12ce-41cc-873e-a43d3c86377b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:09.608081 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-c09fda27-12ce-41cc-873e-a43d3c86377b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045091 Oct 28 19:10:09.608633 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 272/524] 10.222.0.58 () {60 vars in 1343 bytes} [Fri Oct 28 19:10:09 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:10:09.655342 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b4e1eea5-1eea-4652-a082-e67d91f7ec7a tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:09.656563 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b4e1eea5-1eea-4652-a082-e67d91f7ec7a tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:09.662914 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b4e1eea5-1eea-4652-a082-e67d91f7ec7a tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:09.663435 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b4e1eea5-1eea-4652-a082-e67d91f7ec7a tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:09.663877 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b4e1eea5-1eea-4652-a082-e67d91f7ec7a tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:09.664568 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b4e1eea5-1eea-4652-a082-e67d91f7ec7a tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:09.665023 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b4e1eea5-1eea-4652-a082-e67d91f7ec7a tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:09.665452 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b4e1eea5-1eea-4652-a082-e67d91f7ec7a tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:09.724536 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b4e1eea5-1eea-4652-a082-e67d91f7ec7a tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:09.732064 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b4e1eea5-1eea-4652-a082-e67d91f7ec7a tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1217 microversion: 2.1 time: 0.080574 Oct 28 19:10:09.732638 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 253/525] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:09 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:10.620629 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f7c613ee-6a9d-422e-8dfe-1e929c04e16b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:10.622744 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f7c613ee-6a9d-422e-8dfe-1e929c04e16b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:10.628649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7c613ee-6a9d-422e-8dfe-1e929c04e16b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:10.629121 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7c613ee-6a9d-422e-8dfe-1e929c04e16b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:10.629549 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7c613ee-6a9d-422e-8dfe-1e929c04e16b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:10.630222 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7c613ee-6a9d-422e-8dfe-1e929c04e16b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:10.630669 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7c613ee-6a9d-422e-8dfe-1e929c04e16b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:10.631178 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7c613ee-6a9d-422e-8dfe-1e929c04e16b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:10.659883 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f7c613ee-6a9d-422e-8dfe-1e929c04e16b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043249 Oct 28 19:10:10.660416 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 273/526] 10.222.0.58 () {60 vars in 1343 bytes} [Fri Oct 28 19:10:10 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:10:10.753592 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-efae83da-2f6d-4cfc-8b36-e7e917b9dd82 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:10.754214 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-efae83da-2f6d-4cfc-8b36-e7e917b9dd82 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:10.760931 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-efae83da-2f6d-4cfc-8b36-e7e917b9dd82 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:10.761409 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-efae83da-2f6d-4cfc-8b36-e7e917b9dd82 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:10.761845 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-efae83da-2f6d-4cfc-8b36-e7e917b9dd82 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:10.762531 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-efae83da-2f6d-4cfc-8b36-e7e917b9dd82 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:10.763000 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-efae83da-2f6d-4cfc-8b36-e7e917b9dd82 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:10.763428 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-efae83da-2f6d-4cfc-8b36-e7e917b9dd82 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:10.830384 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-efae83da-2f6d-4cfc-8b36-e7e917b9dd82 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:10.838085 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-efae83da-2f6d-4cfc-8b36-e7e917b9dd82 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1217 microversion: 2.1 time: 0.088369 Oct 28 19:10:10.839016 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 254/527] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:10 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:11.672835 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-86b8ffd4-6384-4d6b-a8e0-437e60c3210b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:11.675008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-86b8ffd4-6384-4d6b-a8e0-437e60c3210b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:11.680830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86b8ffd4-6384-4d6b-a8e0-437e60c3210b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:11.681300 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86b8ffd4-6384-4d6b-a8e0-437e60c3210b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:11.681730 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86b8ffd4-6384-4d6b-a8e0-437e60c3210b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:11.682399 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86b8ffd4-6384-4d6b-a8e0-437e60c3210b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:11.682838 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86b8ffd4-6384-4d6b-a8e0-437e60c3210b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:11.683286 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86b8ffd4-6384-4d6b-a8e0-437e60c3210b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:11.712145 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-86b8ffd4-6384-4d6b-a8e0-437e60c3210b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043779 Oct 28 19:10:11.712677 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 274/528] 10.222.0.58 () {60 vars in 1343 bytes} [Fri Oct 28 19:10:11 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:10:11.861196 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d03bec16-1d97-4569-877c-120782d512ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:11.861806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d03bec16-1d97-4569-877c-120782d512ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:11.868223 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d03bec16-1d97-4569-877c-120782d512ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:11.868654 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d03bec16-1d97-4569-877c-120782d512ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:11.869092 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d03bec16-1d97-4569-877c-120782d512ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:11.869814 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d03bec16-1d97-4569-877c-120782d512ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:11.870269 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d03bec16-1d97-4569-877c-120782d512ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:11.870695 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d03bec16-1d97-4569-877c-120782d512ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:11.933718 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d03bec16-1d97-4569-877c-120782d512ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:11.942336 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d03bec16-1d97-4569-877c-120782d512ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1217 microversion: 2.1 time: 0.085371 Oct 28 19:10:11.943356 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 255/529] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:11 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:12.726410 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-d24df267-778c-4632-aaef-2ec9e816450a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:12.731792 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-d24df267-778c-4632-aaef-2ec9e816450a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:12.742700 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d24df267-778c-4632-aaef-2ec9e816450a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:12.743260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d24df267-778c-4632-aaef-2ec9e816450a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:12.746040 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d24df267-778c-4632-aaef-2ec9e816450a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:12.746776 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d24df267-778c-4632-aaef-2ec9e816450a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:12.748751 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d24df267-778c-4632-aaef-2ec9e816450a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:12.749199 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d24df267-778c-4632-aaef-2ec9e816450a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:12.799768 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-d24df267-778c-4632-aaef-2ec9e816450a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079040 Oct 28 19:10:12.800658 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 275/530] 10.222.0.58 () {60 vars in 1343 bytes} [Fri Oct 28 19:10:12 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:10:12.966090 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-df3adcda-301a-490f-8f30-0680b22acaa9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:12.967197 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-df3adcda-301a-490f-8f30-0680b22acaa9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:12.975330 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-df3adcda-301a-490f-8f30-0680b22acaa9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:12.975974 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-df3adcda-301a-490f-8f30-0680b22acaa9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:12.976281 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-df3adcda-301a-490f-8f30-0680b22acaa9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:12.977144 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-df3adcda-301a-490f-8f30-0680b22acaa9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:12.977701 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-df3adcda-301a-490f-8f30-0680b22acaa9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:12.978288 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-df3adcda-301a-490f-8f30-0680b22acaa9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:13.039941 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-df3adcda-301a-490f-8f30-0680b22acaa9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:13.047780 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-df3adcda-301a-490f-8f30-0680b22acaa9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1209 microversion: 2.1 time: 0.085920 Oct 28 19:10:13.048348 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 256/531] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:12 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:13.812701 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-8ae5b3fe-cb5a-4f11-b756-c6d65d87f8ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:13.815528 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-8ae5b3fe-cb5a-4f11-b756-c6d65d87f8ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:13.817625 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=2 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:13.818299 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=6 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:13.823663 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8ae5b3fe-cb5a-4f11-b756-c6d65d87f8ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:13.824226 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8ae5b3fe-cb5a-4f11-b756-c6d65d87f8ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:13.824729 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8ae5b3fe-cb5a-4f11-b756-c6d65d87f8ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:13.825436 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8ae5b3fe-cb5a-4f11-b756-c6d65d87f8ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:13.825889 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8ae5b3fe-cb5a-4f11-b756-c6d65d87f8ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:13.826314 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8ae5b3fe-cb5a-4f11-b756-c6d65d87f8ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:13.860853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-8ae5b3fe-cb5a-4f11-b756-c6d65d87f8ac tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052139 Oct 28 19:10:13.861789 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 276/532] 10.222.0.58 () {60 vars in 1343 bytes} [Fri Oct 28 19:10:13 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:10:14.073235 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-1fbf5db6-18e8-4061-92d4-48471ae31551 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:14.073933 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-1fbf5db6-18e8-4061-92d4-48471ae31551 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:14.080272 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell0:SELECT=2 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:14.083087 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1fbf5db6-18e8-4061-92d4-48471ae31551 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:14.083577 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1fbf5db6-18e8-4061-92d4-48471ae31551 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:14.084020 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1fbf5db6-18e8-4061-92d4-48471ae31551 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:14.085802 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1fbf5db6-18e8-4061-92d4-48471ae31551 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:14.086614 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1fbf5db6-18e8-4061-92d4-48471ae31551 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:14.089685 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1fbf5db6-18e8-4061-92d4-48471ae31551 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:14.180622 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a40f932d-02a3-4ac8-a341-2f226b243ea6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:14.183145 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-a40f932d-02a3-4ac8-a341-2f226b243ea6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:14.185194 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1fbf5db6-18e8-4061-92d4-48471ae31551 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:14.189324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a40f932d-02a3-4ac8-a341-2f226b243ea6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:14.189877 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a40f932d-02a3-4ac8-a341-2f226b243ea6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:14.190392 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a40f932d-02a3-4ac8-a341-2f226b243ea6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:14.191248 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a40f932d-02a3-4ac8-a341-2f226b243ea6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:14.191785 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a40f932d-02a3-4ac8-a341-2f226b243ea6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:14.192282 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a40f932d-02a3-4ac8-a341-2f226b243ea6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:14.192942 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-1fbf5db6-18e8-4061-92d4-48471ae31551 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1265 microversion: 2.1 time: 0.126458 Oct 28 19:10:14.193569 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 257/533] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:14 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1265 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:14.215628 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.objects.instance [None req-a40f932d-02a3-4ac8-a341-2f226b243ea6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lazy-loading 'flavor' on Instance uuid 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f {{(pid=118874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:14.335007 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-a40f932d-02a3-4ac8-a341-2f226b243ea6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "POST /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/action" status: 200 len: 32 microversion: 2.1 time: 0.158483 Oct 28 19:10:14.335645 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 277/534] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Oct 28 19:10:14 2022] POST /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 19:10:14.345096 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-56f3df84-6617-4b7d-bee4-bd7bdc7a2e9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:14.345731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-56f3df84-6617-4b7d-bee4-bd7bdc7a2e9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:14.351929 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-56f3df84-6617-4b7d-bee4-bd7bdc7a2e9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:14.352413 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-56f3df84-6617-4b7d-bee4-bd7bdc7a2e9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:14.352853 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-56f3df84-6617-4b7d-bee4-bd7bdc7a2e9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:14.353546 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-56f3df84-6617-4b7d-bee4-bd7bdc7a2e9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:14.354000 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-56f3df84-6617-4b7d-bee4-bd7bdc7a2e9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:14.354428 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-56f3df84-6617-4b7d-bee4-bd7bdc7a2e9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:14.485038 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-56f3df84-6617-4b7d-bee4-bd7bdc7a2e9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:14.493391 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-56f3df84-6617-4b7d-bee4-bd7bdc7a2e9e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.152108 Oct 28 19:10:14.494040 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 258/535] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:14 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:14.876580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-eb1ae6a0-b7ac-42f2-99a2-e4abbcd8e7b8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:14.879052 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-eb1ae6a0-b7ac-42f2-99a2-e4abbcd8e7b8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:14.886453 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-eb1ae6a0-b7ac-42f2-99a2-e4abbcd8e7b8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:14.887336 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-eb1ae6a0-b7ac-42f2-99a2-e4abbcd8e7b8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:14.888250 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-eb1ae6a0-b7ac-42f2-99a2-e4abbcd8e7b8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:14.889025 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-eb1ae6a0-b7ac-42f2-99a2-e4abbcd8e7b8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:14.889488 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-eb1ae6a0-b7ac-42f2-99a2-e4abbcd8e7b8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:14.889909 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-eb1ae6a0-b7ac-42f2-99a2-e4abbcd8e7b8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:14.906834 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:14.923525 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-eb1ae6a0-b7ac-42f2-99a2-e4abbcd8e7b8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052285 Oct 28 19:10:14.924088 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 278/536] 10.222.0.58 () {60 vars in 1343 bytes} [Fri Oct 28 19:10:14 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:10:15.189535 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-89a669de-ec17-4f4a-b304-e1cbe72dd035 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:15.201266 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-89a669de-ec17-4f4a-b304-e1cbe72dd035 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.201756 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-89a669de-ec17-4f4a-b304-e1cbe72dd035 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.202195 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-89a669de-ec17-4f4a-b304-e1cbe72dd035 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.221005 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-3b5d85d6-80a6-4d0f-b8e9-c21f8f0de665 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:15.222003 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-3b5d85d6-80a6-4d0f-b8e9-c21f8f0de665 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:15.233077 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3b5d85d6-80a6-4d0f-b8e9-c21f8f0de665 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.233815 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3b5d85d6-80a6-4d0f-b8e9-c21f8f0de665 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.234624 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3b5d85d6-80a6-4d0f-b8e9-c21f8f0de665 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.239049 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3b5d85d6-80a6-4d0f-b8e9-c21f8f0de665 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.239906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3b5d85d6-80a6-4d0f-b8e9-c21f8f0de665 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.240563 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3b5d85d6-80a6-4d0f-b8e9-c21f8f0de665 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.288640 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-89a669de-ec17-4f4a-b304-e1cbe72dd035 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Going to try to stop instance {{(pid=118875) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 19:10:15.316585 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:15.335979 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3b5d85d6-80a6-4d0f-b8e9-c21f8f0de665 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:15.344031 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-3b5d85d6-80a6-4d0f-b8e9-c21f8f0de665 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1273 microversion: 2.1 time: 0.127162 Oct 28 19:10:15.344768 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-89a669de-ec17-4f4a-b304-e1cbe72dd035 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "POST /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/action" status: 202 len: 0 microversion: 2.1 time: 0.158099 Oct 28 19:10:15.348823 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 259/537] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Oct 28 19:10:15 2022] POST /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:15.350207 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 279/538] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:15 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1273 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:15.357791 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-a43bd615-3b47-4bda-9be3-354dce032b5e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:15.358502 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-a43bd615-3b47-4bda-9be3-354dce032b5e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:15.366094 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a43bd615-3b47-4bda-9be3-354dce032b5e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.366593 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a43bd615-3b47-4bda-9be3-354dce032b5e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.367067 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a43bd615-3b47-4bda-9be3-354dce032b5e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.367820 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a43bd615-3b47-4bda-9be3-354dce032b5e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.368283 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a43bd615-3b47-4bda-9be3-354dce032b5e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.368716 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a43bd615-3b47-4bda-9be3-354dce032b5e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.517498 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-9362777b-99e2-4c01-a724-b4ef6b5a3a64 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:15.518146 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-9362777b-99e2-4c01-a724-b4ef6b5a3a64 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:15.523996 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9362777b-99e2-4c01-a724-b4ef6b5a3a64 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.524470 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9362777b-99e2-4c01-a724-b4ef6b5a3a64 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.524902 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9362777b-99e2-4c01-a724-b4ef6b5a3a64 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.525692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9362777b-99e2-4c01-a724-b4ef6b5a3a64 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.526193 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9362777b-99e2-4c01-a724-b4ef6b5a3a64 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.526612 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9362777b-99e2-4c01-a724-b4ef6b5a3a64 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.548351 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a43bd615-3b47-4bda-9be3-354dce032b5e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:15.556395 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-a43bd615-3b47-4bda-9be3-354dce032b5e tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1678 microversion: 2.1 time: 0.204028 Oct 28 19:10:15.556964 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 260/539] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:15 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:15.663983 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-9362777b-99e2-4c01-a724-b4ef6b5a3a64 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:15.672405 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-9362777b-99e2-4c01-a724-b4ef6b5a3a64 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.158953 Oct 28 19:10:15.673259 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 280/540] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:15 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:15.937205 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-012b25eb-d07a-4099-8449-6802b8484f27 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:15.948447 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-012b25eb-d07a-4099-8449-6802b8484f27 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:15.961254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-012b25eb-d07a-4099-8449-6802b8484f27 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.963649 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-012b25eb-d07a-4099-8449-6802b8484f27 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.964439 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-012b25eb-d07a-4099-8449-6802b8484f27 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.967258 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-012b25eb-d07a-4099-8449-6802b8484f27 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.967994 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-012b25eb-d07a-4099-8449-6802b8484f27 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.968620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-012b25eb-d07a-4099-8449-6802b8484f27 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:16.003169 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-012b25eb-d07a-4099-8449-6802b8484f27 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.070456 Oct 28 19:10:16.004123 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 261/541] 10.222.0.58 () {60 vars in 1343 bytes} [Fri Oct 28 19:10:15 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:16.070561 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-9fcb8f84-c9f4-433a-b29c-2aeb56ff8df2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:16.071777 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-9fcb8f84-c9f4-433a-b29c-2aeb56ff8df2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:16.079226 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9fcb8f84-c9f4-433a-b29c-2aeb56ff8df2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:16.079982 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9fcb8f84-c9f4-433a-b29c-2aeb56ff8df2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:16.080900 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9fcb8f84-c9f4-433a-b29c-2aeb56ff8df2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:16.082394 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9fcb8f84-c9f4-433a-b29c-2aeb56ff8df2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:16.083126 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9fcb8f84-c9f4-433a-b29c-2aeb56ff8df2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:16.083778 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9fcb8f84-c9f4-433a-b29c-2aeb56ff8df2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:16.110275 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-9fcb8f84-c9f4-433a-b29c-2aeb56ff8df2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Going to try to terminate instance {{(pid=118874) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:10:16.191838 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-9fcb8f84-c9f4-433a-b29c-2aeb56ff8df2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "DELETE /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 204 len: 0 microversion: 2.20 time: 0.124914 Oct 28 19:10:16.192621 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 281/542] 10.222.0.58 () {60 vars in 1280 bytes} [Fri Oct 28 19:10:16 2022] DELETE /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:10:16.201293 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-3a92b113-67ef-4653-84f6-1825b07b7d42 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:16.201902 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-3a92b113-67ef-4653-84f6-1825b07b7d42 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:16.209206 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3a92b113-67ef-4653-84f6-1825b07b7d42 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:16.209786 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3a92b113-67ef-4653-84f6-1825b07b7d42 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:16.210228 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3a92b113-67ef-4653-84f6-1825b07b7d42 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:16.210964 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3a92b113-67ef-4653-84f6-1825b07b7d42 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:16.211452 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3a92b113-67ef-4653-84f6-1825b07b7d42 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:16.211878 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3a92b113-67ef-4653-84f6-1825b07b7d42 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:16.374077 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-2e96e5a3-7a0b-453b-99f6-d00ab4215333 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:16.374882 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-2e96e5a3-7a0b-453b-99f6-d00ab4215333 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:16.381417 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2e96e5a3-7a0b-453b-99f6-d00ab4215333 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:16.381888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2e96e5a3-7a0b-453b-99f6-d00ab4215333 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:16.382315 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2e96e5a3-7a0b-453b-99f6-d00ab4215333 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:16.382999 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2e96e5a3-7a0b-453b-99f6-d00ab4215333 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:16.383448 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2e96e5a3-7a0b-453b-99f6-d00ab4215333 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:16.383861 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2e96e5a3-7a0b-453b-99f6-d00ab4215333 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:16.409602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3a92b113-67ef-4653-84f6-1825b07b7d42 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:16.419639 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3a92b113-67ef-4653-84f6-1825b07b7d42 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:16.421139 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3a92b113-67ef-4653-84f6-1825b07b7d42 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:16.422849 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-3a92b113-67ef-4653-84f6-1825b07b7d42 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.225307 Oct 28 19:10:16.423533 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 262/543] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:16 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:16.580696 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-f092c6b1-a220-4027-a19e-bf7a3bc1cbdf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:16.580966 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-2e96e5a3-7a0b-453b-99f6-d00ab4215333 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:16.581331 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-f092c6b1-a220-4027-a19e-bf7a3bc1cbdf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:16.587553 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f092c6b1-a220-4027-a19e-bf7a3bc1cbdf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:16.588045 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f092c6b1-a220-4027-a19e-bf7a3bc1cbdf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:16.588472 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f092c6b1-a220-4027-a19e-bf7a3bc1cbdf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:16.589232 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-2e96e5a3-7a0b-453b-99f6-d00ab4215333 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1313 microversion: 2.1 time: 0.219316 Oct 28 19:10:16.589461 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f092c6b1-a220-4027-a19e-bf7a3bc1cbdf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:16.589992 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f092c6b1-a220-4027-a19e-bf7a3bc1cbdf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:16.590413 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f092c6b1-a220-4027-a19e-bf7a3bc1cbdf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:16.590715 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 282/544] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:16 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:16.695300 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-83ef07d5-4495-41cc-ba41-22c5603336d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:16.696021 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-83ef07d5-4495-41cc-ba41-22c5603336d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:16.701849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-83ef07d5-4495-41cc-ba41-22c5603336d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:16.702262 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-83ef07d5-4495-41cc-ba41-22c5603336d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:16.702686 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-83ef07d5-4495-41cc-ba41-22c5603336d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:16.703393 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-83ef07d5-4495-41cc-ba41-22c5603336d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:16.703863 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-83ef07d5-4495-41cc-ba41-22c5603336d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:16.704280 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-83ef07d5-4495-41cc-ba41-22c5603336d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:16.725146 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-f092c6b1-a220-4027-a19e-bf7a3bc1cbdf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:16.733028 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-f092c6b1-a220-4027-a19e-bf7a3bc1cbdf tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1678 microversion: 2.1 time: 0.156559 Oct 28 19:10:16.734219 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 263/545] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:16 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:16.832014 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-83ef07d5-4495-41cc-ba41-22c5603336d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:16.840460 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-83ef07d5-4495-41cc-ba41-22c5603336d3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.149119 Oct 28 19:10:16.841035 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 283/546] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:16 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:17.448917 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-cc7d16a3-d103-406a-af5c-2384a091ea1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:17.449518 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-cc7d16a3-d103-406a-af5c-2384a091ea1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:17.456584 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cc7d16a3-d103-406a-af5c-2384a091ea1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:17.457069 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cc7d16a3-d103-406a-af5c-2384a091ea1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:17.457511 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cc7d16a3-d103-406a-af5c-2384a091ea1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:17.458201 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cc7d16a3-d103-406a-af5c-2384a091ea1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:17.458657 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cc7d16a3-d103-406a-af5c-2384a091ea1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:17.459113 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cc7d16a3-d103-406a-af5c-2384a091ea1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:17.584074 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-cc7d16a3-d103-406a-af5c-2384a091ea1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:17.592208 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-cc7d16a3-d103-406a-af5c-2384a091ea1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:17.593659 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-cc7d16a3-d103-406a-af5c-2384a091ea1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:17.594860 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-cc7d16a3-d103-406a-af5c-2384a091ea1f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.149946 Oct 28 19:10:17.595458 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 264/547] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:17 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:17.614101 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-80510260-9803-4f86-974b-651d1f11f024 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:17.615076 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-80510260-9803-4f86-974b-651d1f11f024 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:17.620793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-80510260-9803-4f86-974b-651d1f11f024 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:17.621270 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-80510260-9803-4f86-974b-651d1f11f024 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:17.621705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-80510260-9803-4f86-974b-651d1f11f024 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:17.622385 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-80510260-9803-4f86-974b-651d1f11f024 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:17.622832 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-80510260-9803-4f86-974b-651d1f11f024 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:17.623311 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-80510260-9803-4f86-974b-651d1f11f024 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:17.753613 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-80510260-9803-4f86-974b-651d1f11f024 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:17.757410 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-db9f4084-6e67-46e6-b06d-8abbe7df2b89 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:17.758028 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-db9f4084-6e67-46e6-b06d-8abbe7df2b89 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:17.761383 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-80510260-9803-4f86-974b-651d1f11f024 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1313 microversion: 2.1 time: 0.151635 Oct 28 19:10:17.761944 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 284/548] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:17 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:17.764155 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-db9f4084-6e67-46e6-b06d-8abbe7df2b89 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:17.764642 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-db9f4084-6e67-46e6-b06d-8abbe7df2b89 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:17.765089 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-db9f4084-6e67-46e6-b06d-8abbe7df2b89 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:17.765784 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-db9f4084-6e67-46e6-b06d-8abbe7df2b89 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:17.766281 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-db9f4084-6e67-46e6-b06d-8abbe7df2b89 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:17.766709 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-db9f4084-6e67-46e6-b06d-8abbe7df2b89 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:17.864616 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-e024f0e4-7bf6-41ba-90e6-8b942e9dc4e8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:17.865428 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-e024f0e4-7bf6-41ba-90e6-8b942e9dc4e8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:17.871322 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e024f0e4-7bf6-41ba-90e6-8b942e9dc4e8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:17.871875 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e024f0e4-7bf6-41ba-90e6-8b942e9dc4e8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:17.872379 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e024f0e4-7bf6-41ba-90e6-8b942e9dc4e8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:17.873135 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e024f0e4-7bf6-41ba-90e6-8b942e9dc4e8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:17.873586 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e024f0e4-7bf6-41ba-90e6-8b942e9dc4e8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:17.874005 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e024f0e4-7bf6-41ba-90e6-8b942e9dc4e8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:17.892587 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-db9f4084-6e67-46e6-b06d-8abbe7df2b89 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:17.900946 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-db9f4084-6e67-46e6-b06d-8abbe7df2b89 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1678 microversion: 2.1 time: 0.147252 Oct 28 19:10:17.901650 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 265/549] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:17 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:18.005174 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e024f0e4-7bf6-41ba-90e6-8b942e9dc4e8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:18.014179 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-e024f0e4-7bf6-41ba-90e6-8b942e9dc4e8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.153346 Oct 28 19:10:18.019351 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 285/550] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:17 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:18.620399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-1d55f0e4-6928-49d7-b10b-40bc919cb856 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:18.621000 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-1d55f0e4-6928-49d7-b10b-40bc919cb856 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:18.627808 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1d55f0e4-6928-49d7-b10b-40bc919cb856 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:18.628565 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1d55f0e4-6928-49d7-b10b-40bc919cb856 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:18.629182 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1d55f0e4-6928-49d7-b10b-40bc919cb856 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:18.629884 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1d55f0e4-6928-49d7-b10b-40bc919cb856 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:18.630333 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1d55f0e4-6928-49d7-b10b-40bc919cb856 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:18.630754 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1d55f0e4-6928-49d7-b10b-40bc919cb856 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:18.679781 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-b8c4b404-a3ba-4ead-aa67-1e6383f1c03e req-f0185e3c-e0a8-445f-9637-32066256d9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3994c112-84fe-4489-8f22-67ea315209d4", "tag": "a3a38617-7845-41ed-9a88-b13f0d396c88"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:18.691325 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-b8c4b404-a3ba-4ead-aa67-1e6383f1c03e req-f0185e3c-e0a8-445f-9637-32066256d9f6 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:18.692070 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-b8c4b404-a3ba-4ead-aa67-1e6383f1c03e req-f0185e3c-e0a8-445f-9637-32066256d9f6 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:18.693266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-b8c4b404-a3ba-4ead-aa67-1e6383f1c03e req-f0185e3c-e0a8-445f-9637-32066256d9f6 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:18.706200 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-b8c4b404-a3ba-4ead-aa67-1e6383f1c03e req-f0185e3c-e0a8-445f-9637-32066256d9f6 service nova] Creating event network-changed:a3a38617-7845-41ed-9a88-b13f0d396c88 for instance 3994c112-84fe-4489-8f22-67ea315209d4 on hv-cinder-86236 Oct 28 19:10:18.714486 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-b8c4b404-a3ba-4ead-aa67-1e6383f1c03e req-f0185e3c-e0a8-445f-9637-32066256d9f6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038534 Oct 28 19:10:18.715703 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 286/551] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:18.783908 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-dfec8c40-8eb8-4db1-817f-6004aad4c6ed tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:18.784606 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-dfec8c40-8eb8-4db1-817f-6004aad4c6ed tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:18.791077 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-dfec8c40-8eb8-4db1-817f-6004aad4c6ed tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:18.791659 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-dfec8c40-8eb8-4db1-817f-6004aad4c6ed tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:18.792138 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-dfec8c40-8eb8-4db1-817f-6004aad4c6ed tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:18.792927 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-dfec8c40-8eb8-4db1-817f-6004aad4c6ed tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:18.793445 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-dfec8c40-8eb8-4db1-817f-6004aad4c6ed tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:18.794134 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-dfec8c40-8eb8-4db1-817f-6004aad4c6ed tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:18.919057 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1d55f0e4-6928-49d7-b10b-40bc919cb856 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:18.928059 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1d55f0e4-6928-49d7-b10b-40bc919cb856 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:18.929553 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1d55f0e4-6928-49d7-b10b-40bc919cb856 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:18.930722 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-1d55f0e4-6928-49d7-b10b-40bc919cb856 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1723 microversion: 2.20 time: 0.314257 Oct 28 19:10:18.932348 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 266/552] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:18 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:18.956454 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-02367d1f-f5b9-418b-9a44-04a400b2604b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:18.957257 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-02367d1f-f5b9-418b-9a44-04a400b2604b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:18.963332 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-02367d1f-f5b9-418b-9a44-04a400b2604b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:18.963826 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-02367d1f-f5b9-418b-9a44-04a400b2604b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:18.964271 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-02367d1f-f5b9-418b-9a44-04a400b2604b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:18.964977 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-02367d1f-f5b9-418b-9a44-04a400b2604b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:18.965494 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-02367d1f-f5b9-418b-9a44-04a400b2604b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:18.965929 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-02367d1f-f5b9-418b-9a44-04a400b2604b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:19.118481 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-dfec8c40-8eb8-4db1-817f-6004aad4c6ed tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:19.128106 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-dfec8c40-8eb8-4db1-817f-6004aad4c6ed tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1313 microversion: 2.1 time: 0.348284 Oct 28 19:10:19.132559 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 287/553] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:18 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:19.144365 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4aa21a75-64db-4893-828d-8e0dfbf8d5df tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-446938584"}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:19.145627 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-4aa21a75-64db-4893-828d-8e0dfbf8d5df tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:19.154266 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4aa21a75-64db-4893-828d-8e0dfbf8d5df tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:19.154966 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4aa21a75-64db-4893-828d-8e0dfbf8d5df tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:19.156146 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4aa21a75-64db-4893-828d-8e0dfbf8d5df tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:19.156424 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4aa21a75-64db-4893-828d-8e0dfbf8d5df tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:19.157129 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4aa21a75-64db-4893-828d-8e0dfbf8d5df tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:19.157658 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4aa21a75-64db-4893-828d-8e0dfbf8d5df tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:19.236511 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-02367d1f-f5b9-418b-9a44-04a400b2604b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:19.245160 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-02367d1f-f5b9-418b-9a44-04a400b2604b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1678 microversion: 2.1 time: 0.300954 Oct 28 19:10:19.247023 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 267/554] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:18 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1678 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:19.254743 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-91ff9d7d-a0bf-47bf-9e67-3d1fed294c0b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:19.255407 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-91ff9d7d-a0bf-47bf-9e67-3d1fed294c0b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:19.264043 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-91ff9d7d-a0bf-47bf-9e67-3d1fed294c0b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:19.264550 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-91ff9d7d-a0bf-47bf-9e67-3d1fed294c0b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:19.265009 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-91ff9d7d-a0bf-47bf-9e67-3d1fed294c0b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:19.266066 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-91ff9d7d-a0bf-47bf-9e67-3d1fed294c0b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:19.266259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-91ff9d7d-a0bf-47bf-9e67-3d1fed294c0b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:19.266701 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-91ff9d7d-a0bf-47bf-9e67-3d1fed294c0b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:19.684927 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.network.security_group_api [None req-4aa21a75-64db-4893-828d-8e0dfbf8d5df tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Removing security group a7503446-424f-49ce-a1b5-fca931425411 from port 6c0693d1-2c4b-4d7e-952e-42bbac4297f8 Oct 28 19:10:19.833202 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-91ff9d7d-a0bf-47bf-9e67-3d1fed294c0b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:19.851411 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-91ff9d7d-a0bf-47bf-9e67-3d1fed294c0b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.603296 Oct 28 19:10:19.873667 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 268/555] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:19 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:19.878630 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-2d5b14c7-dfa5-49ea-ae48-573aed381b3e req-71eccc3f-d5ae-4c15-80a5-fb261becc43e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "777c1a8e-485a-4333-a800-8586cdc8746b", "name": "network-vif-deleted", "tag": "63e7b2ed-34d6-4aba-a769-655ad469dbc0"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:19.888541 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-2d5b14c7-dfa5-49ea-ae48-573aed381b3e req-71eccc3f-d5ae-4c15-80a5-fb261becc43e service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:19.889016 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-2d5b14c7-dfa5-49ea-ae48-573aed381b3e req-71eccc3f-d5ae-4c15-80a5-fb261becc43e service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:19.889448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-2d5b14c7-dfa5-49ea-ae48-573aed381b3e req-71eccc3f-d5ae-4c15-80a5-fb261becc43e service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:19.901401 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-2d5b14c7-dfa5-49ea-ae48-573aed381b3e req-71eccc3f-d5ae-4c15-80a5-fb261becc43e service nova] Creating event network-vif-deleted:63e7b2ed-34d6-4aba-a769-655ad469dbc0 for instance 777c1a8e-485a-4333-a800-8586cdc8746b on hv-cinder-86236 Oct 28 19:10:19.907342 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-2d5b14c7-dfa5-49ea-ae48-573aed381b3e req-71eccc3f-d5ae-4c15-80a5-fb261becc43e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031595 Oct 28 19:10:19.910882 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 269/556] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:19.963168 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d44405fd-f207-4538-ae57-03e99567090f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:19.963867 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d44405fd-f207-4538-ae57-03e99567090f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:19.970961 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d44405fd-f207-4538-ae57-03e99567090f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:19.971424 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d44405fd-f207-4538-ae57-03e99567090f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:19.971874 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d44405fd-f207-4538-ae57-03e99567090f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:19.972558 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d44405fd-f207-4538-ae57-03e99567090f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:19.973003 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d44405fd-f207-4538-ae57-03e99567090f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:19.973602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d44405fd-f207-4538-ae57-03e99567090f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:20.006864 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d44405fd-f207-4538-ae57-03e99567090f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:20.007370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d44405fd-f207-4538-ae57-03e99567090f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:20.007997 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d44405fd-f207-4538-ae57-03e99567090f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:20.008452 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.objects.instance [None req-d44405fd-f207-4538-ae57-03e99567090f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lazy-loading 'fault' on Instance uuid 777c1a8e-485a-4333-a800-8586cdc8746b {{(pid=118875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:20.058753 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d44405fd-f207-4538-ae57-03e99567090f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:20.067865 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d44405fd-f207-4538-ae57-03e99567090f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:20.069353 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d44405fd-f207-4538-ae57-03e99567090f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:20.070514 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d44405fd-f207-4538-ae57-03e99567090f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1371 microversion: 2.20 time: 0.111720 Oct 28 19:10:20.083082 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 270/557] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:19 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:20.139438 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-4aa21a75-64db-4893-828d-8e0dfbf8d5df tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "POST /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c/action" status: 202 len: 0 microversion: 2.1 time: 1.005398 Oct 28 19:10:20.140487 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 288/558] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Oct 28 19:10:19 2022] POST /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c/action => generated 0 bytes in 1007 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:20.157089 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-410f31a4-2fb3-4bad-a416-4fff667d35c8 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:20.157720 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-410f31a4-2fb3-4bad-a416-4fff667d35c8 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:20.173225 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-410f31a4-2fb3-4bad-a416-4fff667d35c8 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:20.173720 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-410f31a4-2fb3-4bad-a416-4fff667d35c8 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:20.174160 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-410f31a4-2fb3-4bad-a416-4fff667d35c8 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:20.176604 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-410f31a4-2fb3-4bad-a416-4fff667d35c8 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:20.177071 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-410f31a4-2fb3-4bad-a416-4fff667d35c8 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:20.178918 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-410f31a4-2fb3-4bad-a416-4fff667d35c8 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:20.272552 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-fca68911-5cde-48ad-8f6e-fc84e7f5f726 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:20.273454 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-fca68911-5cde-48ad-8f6e-fc84e7f5f726 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:20.291610 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fca68911-5cde-48ad-8f6e-fc84e7f5f726 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:20.292329 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fca68911-5cde-48ad-8f6e-fc84e7f5f726 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:20.292919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fca68911-5cde-48ad-8f6e-fc84e7f5f726 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:20.294075 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fca68911-5cde-48ad-8f6e-fc84e7f5f726 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:20.294702 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fca68911-5cde-48ad-8f6e-fc84e7f5f726 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:20.295328 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fca68911-5cde-48ad-8f6e-fc84e7f5f726 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:20.399879 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-410f31a4-2fb3-4bad-a416-4fff667d35c8 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:20.410899 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-410f31a4-2fb3-4bad-a416-4fff667d35c8 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1313 microversion: 2.1 time: 0.262246 Oct 28 19:10:20.411727 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 271/559] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:20 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:20.543395 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-fca68911-5cde-48ad-8f6e-fc84e7f5f726 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:20.552824 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-fca68911-5cde-48ad-8f6e-fc84e7f5f726 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1678 microversion: 2.1 time: 0.286732 Oct 28 19:10:20.568203 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 289/560] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:20 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1678 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:20.746936 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-6836069c-3044-48dc-8a5c-9e39bae15142 req-9a16a76d-4012-47f4-ba0b-5d326f4c01f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be43ea5-02f7-43db-8ac7-df770da3592c", "tag": "6c0693d1-2c4b-4d7e-952e-42bbac4297f8"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:20.763755 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-6836069c-3044-48dc-8a5c-9e39bae15142 req-9a16a76d-4012-47f4-ba0b-5d326f4c01f0 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:20.764540 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-6836069c-3044-48dc-8a5c-9e39bae15142 req-9a16a76d-4012-47f4-ba0b-5d326f4c01f0 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:20.765377 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-6836069c-3044-48dc-8a5c-9e39bae15142 req-9a16a76d-4012-47f4-ba0b-5d326f4c01f0 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:20.796440 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-6836069c-3044-48dc-8a5c-9e39bae15142 req-9a16a76d-4012-47f4-ba0b-5d326f4c01f0 service nova] Creating event network-changed:6c0693d1-2c4b-4d7e-952e-42bbac4297f8 for instance 6be43ea5-02f7-43db-8ac7-df770da3592c on hv-cinder-86236 Oct 28 19:10:20.802166 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-6836069c-3044-48dc-8a5c-9e39bae15142 req-9a16a76d-4012-47f4-ba0b-5d326f4c01f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059313 Oct 28 19:10:20.803157 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 272/561] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:20.883116 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-b1a883f9-dc70-432c-9ce5-4d272ad18799 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:20.885119 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-b1a883f9-dc70-432c-9ce5-4d272ad18799 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:20.892704 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b1a883f9-dc70-432c-9ce5-4d272ad18799 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:20.893318 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b1a883f9-dc70-432c-9ce5-4d272ad18799 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:20.894437 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b1a883f9-dc70-432c-9ce5-4d272ad18799 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:20.895377 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b1a883f9-dc70-432c-9ce5-4d272ad18799 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:20.896062 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b1a883f9-dc70-432c-9ce5-4d272ad18799 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:20.896706 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b1a883f9-dc70-432c-9ce5-4d272ad18799 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.040766 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-b1a883f9-dc70-432c-9ce5-4d272ad18799 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:21.059469 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-b1a883f9-dc70-432c-9ce5-4d272ad18799 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.180119 Oct 28 19:10:21.060669 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 290/562] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:20 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:21.099122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-8e2ca2cb-6590-484a-b405-e4a2a939f6ff tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:21.100436 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-8e2ca2cb-6590-484a-b405-e4a2a939f6ff tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:21.106746 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8e2ca2cb-6590-484a-b405-e4a2a939f6ff tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.107300 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8e2ca2cb-6590-484a-b405-e4a2a939f6ff tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.107747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8e2ca2cb-6590-484a-b405-e4a2a939f6ff tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.108452 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8e2ca2cb-6590-484a-b405-e4a2a939f6ff tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.109075 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8e2ca2cb-6590-484a-b405-e4a2a939f6ff tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.110254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8e2ca2cb-6590-484a-b405-e4a2a939f6ff tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.142711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8e2ca2cb-6590-484a-b405-e4a2a939f6ff tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.143224 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8e2ca2cb-6590-484a-b405-e4a2a939f6ff tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.143658 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8e2ca2cb-6590-484a-b405-e4a2a939f6ff tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.144101 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.objects.instance [None req-8e2ca2cb-6590-484a-b405-e4a2a939f6ff tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lazy-loading 'fault' on Instance uuid 777c1a8e-485a-4333-a800-8586cdc8746b {{(pid=118875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:21.188267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-8e2ca2cb-6590-484a-b405-e4a2a939f6ff tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:21.197992 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-8e2ca2cb-6590-484a-b405-e4a2a939f6ff tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:21.199994 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-8e2ca2cb-6590-484a-b405-e4a2a939f6ff tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:21.201726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-8e2ca2cb-6590-484a-b405-e4a2a939f6ff tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 200 len: 1371 microversion: 2.20 time: 0.107082 Oct 28 19:10:21.223436 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 273/563] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:21 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 1371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:21.438129 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-b86d301b-a9db-4e4c-ac66-cc1fbeadbe91 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:21.439609 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-b86d301b-a9db-4e4c-ac66-cc1fbeadbe91 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:21.448368 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b86d301b-a9db-4e4c-ac66-cc1fbeadbe91 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.448860 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b86d301b-a9db-4e4c-ac66-cc1fbeadbe91 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.449299 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b86d301b-a9db-4e4c-ac66-cc1fbeadbe91 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.450081 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b86d301b-a9db-4e4c-ac66-cc1fbeadbe91 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.450537 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b86d301b-a9db-4e4c-ac66-cc1fbeadbe91 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.450959 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b86d301b-a9db-4e4c-ac66-cc1fbeadbe91 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.575903 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-dd855382-8eab-415d-95a0-c54afde5d05a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:21.576862 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-dd855382-8eab-415d-95a0-c54afde5d05a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:21.584060 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-dd855382-8eab-415d-95a0-c54afde5d05a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.584820 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-dd855382-8eab-415d-95a0-c54afde5d05a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.585450 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-dd855382-8eab-415d-95a0-c54afde5d05a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.586329 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-dd855382-8eab-415d-95a0-c54afde5d05a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.586943 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-dd855382-8eab-415d-95a0-c54afde5d05a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.587553 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-dd855382-8eab-415d-95a0-c54afde5d05a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.874387 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-b86d301b-a9db-4e4c-ac66-cc1fbeadbe91 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:21.883020 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-b86d301b-a9db-4e4c-ac66-cc1fbeadbe91 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1313 microversion: 2.1 time: 0.452531 Oct 28 19:10:21.895442 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 291/564] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:21 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:21.905862 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-46ad5d2f-5ee3-4362-84bf-c5a40ad1a542 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:21.906600 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-46ad5d2f-5ee3-4362-84bf-c5a40ad1a542 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:21.909313 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-dd855382-8eab-415d-95a0-c54afde5d05a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:21.912800 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46ad5d2f-5ee3-4362-84bf-c5a40ad1a542 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.913522 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46ad5d2f-5ee3-4362-84bf-c5a40ad1a542 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.914168 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46ad5d2f-5ee3-4362-84bf-c5a40ad1a542 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.915384 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46ad5d2f-5ee3-4362-84bf-c5a40ad1a542 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.916033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46ad5d2f-5ee3-4362-84bf-c5a40ad1a542 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.916678 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46ad5d2f-5ee3-4362-84bf-c5a40ad1a542 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.919840 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-dd855382-8eab-415d-95a0-c54afde5d05a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1678 microversion: 2.1 time: 0.347695 Oct 28 19:10:21.920709 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 274/565] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:21 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1678 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:21.925721 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-47909088-9a26-4369-9fd2-812fbfa94f04 req-b7cfe193-2f9a-413b-a255-c042bedb15b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be43ea5-02f7-43db-8ac7-df770da3592c", "tag": "6c0693d1-2c4b-4d7e-952e-42bbac4297f8"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:21.940918 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-47909088-9a26-4369-9fd2-812fbfa94f04 req-b7cfe193-2f9a-413b-a255-c042bedb15b3 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.942134 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-47909088-9a26-4369-9fd2-812fbfa94f04 req-b7cfe193-2f9a-413b-a255-c042bedb15b3 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.942582 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-47909088-9a26-4369-9fd2-812fbfa94f04 req-b7cfe193-2f9a-413b-a255-c042bedb15b3 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.959698 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-47909088-9a26-4369-9fd2-812fbfa94f04 req-b7cfe193-2f9a-413b-a255-c042bedb15b3 service nova] Creating event network-changed:6c0693d1-2c4b-4d7e-952e-42bbac4297f8 for instance 6be43ea5-02f7-43db-8ac7-df770da3592c on hv-cinder-86236 Oct 28 19:10:21.964719 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-47909088-9a26-4369-9fd2-812fbfa94f04 req-b7cfe193-2f9a-413b-a255-c042bedb15b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042892 Oct 28 19:10:21.967205 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 275/566] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:22.021855 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.objects.instance [None req-46ad5d2f-5ee3-4362-84bf-c5a40ad1a542 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lazy-loading 'services' on Instance uuid 6be43ea5-02f7-43db-8ac7-df770da3592c {{(pid=118874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:22.085289 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-4828292a-d2a5-441b-afae-181fe3188704 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:22.086194 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-4828292a-d2a5-441b-afae-181fe3188704 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:22.093262 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4828292a-d2a5-441b-afae-181fe3188704 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.094178 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4828292a-d2a5-441b-afae-181fe3188704 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.094795 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4828292a-d2a5-441b-afae-181fe3188704 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:22.095716 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4828292a-d2a5-441b-afae-181fe3188704 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.096331 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4828292a-d2a5-441b-afae-181fe3188704 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.096922 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4828292a-d2a5-441b-afae-181fe3188704 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:22.103846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-46ad5d2f-5ee3-4362-84bf-c5a40ad1a542 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c/os-volume_attachments/85856c7f-ed0d-46b1-befe-3881f94371a5" status: 202 len: 0 microversion: 2.1 time: 0.205962 Oct 28 19:10:22.105105 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 292/567] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Oct 28 19:10:21 2022] DELETE /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c/os-volume_attachments/85856c7f-ed0d-46b1-befe-3881f94371a5 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:22.114752 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-659ac1ad-948e-4995-92a5-b5a6f5ebd08c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:22.117504 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-659ac1ad-948e-4995-92a5-b5a6f5ebd08c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:22.127382 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-659ac1ad-948e-4995-92a5-b5a6f5ebd08c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.129049 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-659ac1ad-948e-4995-92a5-b5a6f5ebd08c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.129864 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-659ac1ad-948e-4995-92a5-b5a6f5ebd08c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:22.130864 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-659ac1ad-948e-4995-92a5-b5a6f5ebd08c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.132167 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-659ac1ad-948e-4995-92a5-b5a6f5ebd08c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.133865 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-659ac1ad-948e-4995-92a5-b5a6f5ebd08c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:22.181893 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:22.186000 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-659ac1ad-948e-4995-92a5-b5a6f5ebd08c tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076479 Oct 28 19:10:22.188446 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 293/568] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Oct 28 19:10:22 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:22.241603 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-85428b03-bca7-4d2b-90c3-fdf7a513b25c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:22.242310 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-85428b03-bca7-4d2b-90c3-fdf7a513b25c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:22.260471 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-85428b03-bca7-4d2b-90c3-fdf7a513b25c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.261147 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-85428b03-bca7-4d2b-90c3-fdf7a513b25c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.261846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-85428b03-bca7-4d2b-90c3-fdf7a513b25c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:22.262697 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-85428b03-bca7-4d2b-90c3-fdf7a513b25c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.264664 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-85428b03-bca7-4d2b-90c3-fdf7a513b25c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.266431 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-85428b03-bca7-4d2b-90c3-fdf7a513b25c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:22.297625 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-85428b03-bca7-4d2b-90c3-fdf7a513b25c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] HTTP exception thrown: Instance 777c1a8e-485a-4333-a800-8586cdc8746b could not be found. Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-85428b03-bca7-4d2b-90c3-fdf7a513b25c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Request method failure captured: Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b HTTP/1.1 Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCgU9nz-cCPlWPtgg2otnEHbawLUXC2pxeKBnCGvMpR9DIBONlkizSHp2dSyLqoxFEgXho1eX_8bWXo6WcZVjON_eSzEjeUbk5LgfieSF95ivXls0P2wweFmekTA3EdqsjTn_SsraqXtX2y1_4XoOMHW_Br2PQy7B-5Km5C35DzXOQM Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: 55bc75ee717c43b7811b0ab11c647f99 Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1524417465 Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:10:22.299760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:10:22.301194 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:10:22.301194 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1524417465 Oct 28 19:10:22.301194 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: 55bc75ee717c43b7811b0ab11c647f99 Oct 28 19:10:22.301194 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1524417465 Oct 28 19:10:22.301194 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-AttachVolumeShelveTestJSON-1524417465-project Oct 28 19:10:22.301194 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:10:22.301194 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:10:22.301194 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: e868bb74b33f467380562aec01a3d3e9 Oct 28 19:10:22.301194 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1524417465-project Oct 28 19:10:22.301194 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: > Oct 28 19:10:22.301194 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Instance 777c1a8e-485a-4333-a800-8586cdc8746b could not be found. Oct 28 19:10:22.301194 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'id': '777c1a8e-485a-4333-a800-8586cdc8746b'} Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 777c1a8e-485a-4333-a800-8586cdc8746b could not be found. Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:22.302104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:22.303361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:22.303361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:10:22.303361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:10:22.303361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:10:22.303361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:10:22.303361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:10:22.303361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:10:22.303361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 777c1a8e-485a-4333-a800-8586cdc8746b could not be found. Oct 28 19:10:22.303361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:10:22.303361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:22.303361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:10:22.303361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:22.303361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:22.303361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:22.303361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:22.303361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:22.303361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 777c1a8e-485a-4333-a800-8586cdc8746b could not be found. Oct 28 19:10:22.303361 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:10:22.306517 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-85428b03-bca7-4d2b-90c3-fdf7a513b25c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Returning 404 to user: Instance 777c1a8e-485a-4333-a800-8586cdc8746b could not be found. {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:22.307629 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-85428b03-bca7-4d2b-90c3-fdf7a513b25c tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 404 len: 111 microversion: 2.20 time: 0.072119 Oct 28 19:10:22.308917 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 294/569] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:22 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 19:10:22.320049 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a2330a7e-37bd-429e-920b-761a0612b2a9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '.version_select at 0x7f9bf673bd30>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:22.340027 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-4828292a-d2a5-441b-afae-181fe3188704 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:22.351798 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-4828292a-d2a5-441b-afae-181fe3188704 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.269205 Oct 28 19:10:22.352037 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-a2330a7e-37bd-429e-920b-761a0612b2a9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095254103" status: 204 len: 0 microversion: 2.20 time: 0.036633 Oct 28 19:10:22.353065 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 276/571] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:22 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:22.353204 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 295/571] 10.222.0.58 () {60 vars in 1262 bytes} [Fri Oct 28 19:10:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095254103 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:10:22.909712 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-aa88f1f6-6ec9-4b98-8c1e-18290808155d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:22.911022 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-aa88f1f6-6ec9-4b98-8c1e-18290808155d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:22.919378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-aa88f1f6-6ec9-4b98-8c1e-18290808155d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.920004 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-aa88f1f6-6ec9-4b98-8c1e-18290808155d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.920672 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-aa88f1f6-6ec9-4b98-8c1e-18290808155d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:22.921476 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-aa88f1f6-6ec9-4b98-8c1e-18290808155d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.923354 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-aa88f1f6-6ec9-4b98-8c1e-18290808155d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.924177 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-aa88f1f6-6ec9-4b98-8c1e-18290808155d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:22.945197 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d7180ca4-9921-4cac-8c9e-c472bde29fcd tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:22.945993 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d7180ca4-9921-4cac-8c9e-c472bde29fcd tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:22.959399 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d7180ca4-9921-4cac-8c9e-c472bde29fcd tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.960094 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d7180ca4-9921-4cac-8c9e-c472bde29fcd tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.960712 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d7180ca4-9921-4cac-8c9e-c472bde29fcd tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:22.962189 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d7180ca4-9921-4cac-8c9e-c472bde29fcd tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.962860 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d7180ca4-9921-4cac-8c9e-c472bde29fcd tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.963333 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d7180ca4-9921-4cac-8c9e-c472bde29fcd tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:23.007484 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:23.296624 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-aa88f1f6-6ec9-4b98-8c1e-18290808155d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:23.305455 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-aa88f1f6-6ec9-4b98-8c1e-18290808155d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1313 microversion: 2.1 time: 0.399622 Oct 28 19:10:23.305957 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 296/572] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:22 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:23.310693 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-13168d10-9107-4cd1-b2b8-6211f097b2ba tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:23.313314 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-13168d10-9107-4cd1-b2b8-6211f097b2ba tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:23.320994 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-13168d10-9107-4cd1-b2b8-6211f097b2ba tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:23.321658 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-13168d10-9107-4cd1-b2b8-6211f097b2ba tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:23.322096 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-13168d10-9107-4cd1-b2b8-6211f097b2ba tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:23.322793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-13168d10-9107-4cd1-b2b8-6211f097b2ba tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:23.323270 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-13168d10-9107-4cd1-b2b8-6211f097b2ba tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:23.323695 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-13168d10-9107-4cd1-b2b8-6211f097b2ba tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:23.352653 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-13168d10-9107-4cd1-b2b8-6211f097b2ba tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045473 Oct 28 19:10:23.353217 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 297/573] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Oct 28 19:10:23 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:10:23.364217 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-571270de-55a7-4ad9-a5ce-1ae669391998 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:23.364790 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-571270de-55a7-4ad9-a5ce-1ae669391998 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:23.371283 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-571270de-55a7-4ad9-a5ce-1ae669391998 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:23.371770 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-571270de-55a7-4ad9-a5ce-1ae669391998 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:23.372213 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-571270de-55a7-4ad9-a5ce-1ae669391998 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:23.372908 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-571270de-55a7-4ad9-a5ce-1ae669391998 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:23.373387 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-571270de-55a7-4ad9-a5ce-1ae669391998 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:23.373834 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-571270de-55a7-4ad9-a5ce-1ae669391998 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:23.382630 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d7180ca4-9921-4cac-8c9e-c472bde29fcd tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:23.392022 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d7180ca4-9921-4cac-8c9e-c472bde29fcd tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1678 microversion: 2.1 time: 0.450600 Oct 28 19:10:23.408288 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 277/574] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:22 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1678 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:23.419741 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-cd29a836-9e90-46a7-915e-c63ba5f3794d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:23.420598 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-cd29a836-9e90-46a7-915e-c63ba5f3794d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:23.433927 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cd29a836-9e90-46a7-915e-c63ba5f3794d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:23.434681 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cd29a836-9e90-46a7-915e-c63ba5f3794d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:23.435351 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cd29a836-9e90-46a7-915e-c63ba5f3794d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:23.436255 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cd29a836-9e90-46a7-915e-c63ba5f3794d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:23.437135 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cd29a836-9e90-46a7-915e-c63ba5f3794d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:23.437765 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-cd29a836-9e90-46a7-915e-c63ba5f3794d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:23.466818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-571270de-55a7-4ad9-a5ce-1ae669391998 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] HTTP exception thrown: Instance 6be43ea5-02f7-43db-8ac7-df770da3592c is not attached to volume 85856c7f-ed0d-46b1-befe-3881f94371a5 Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-571270de-55a7-4ad9-a5ce-1ae669391998 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Request method failure captured: Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: DELETE /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c/os-volume_attachments/85856c7f-ed0d-46b1-befe-3881f94371a5 HTTP/1.1 Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXChpze1BrO8eFwL9TgYucKdSToPPCJZ0vg80CMNatNl8HD6tSljN5Z_1-sAQ--UV-O5lYgwx9lyOQT6uY9u8GY0bzF3k-Q2tBkw038zdBhj_Ft1f3Q0V_VM5RRd3F_oeqGYJmkWK8N9jtGEvXg3U73EE9zKXEyeuTSGXo1HkPXnFnl8 Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: aa4bbb7ba7f14bd9bcaaa0ea461322a6 Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-TestMinimumBasicScenario-932109065 Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:10:23.470026 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:10:23.471636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aa4bbb7ba7f14bd9bcaaa0ea461322a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aa4bbb7ba7f14bd9bcaaa0ea461322a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/aa4bbb7ba7f14bd9bcaaa0ea461322a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_aa4bbb7ba7f14bd9bcaaa0ea461322a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:10:23.471636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-TestMinimumBasicScenario-932109065 Oct 28 19:10:23.471636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: aa4bbb7ba7f14bd9bcaaa0ea461322a6 Oct 28 19:10:23.471636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-TestMinimumBasicScenario-932109065 Oct 28 19:10:23.471636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-TestMinimumBasicScenario-932109065-project Oct 28 19:10:23.471636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:10:23.471636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:10:23.471636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: fec54d8c1ea24cc8bbbeb6fef1fd2028 Oct 28 19:10:23.471636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-TestMinimumBasicScenario-932109065-project Oct 28 19:10:23.471636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: > Oct 28 19:10:23.471636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Instance 6be43ea5-02f7-43db-8ac7-df770da3592c is not attached to volume 85856c7f-ed0d-46b1-befe-3881f94371a5 Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'server_id': '6be43ea5-02f7-43db-8ac7-df770da3592c', 'id': '85856c7f-ed0d-46b1-befe-3881f94371a5'} Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 85856c7f-ed0d-46b1-befe-3881f94371a5. Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:23.472418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:23.473779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:23.473779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 19:10:23.473779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 19:10:23.473779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be43ea5-02f7-43db-8ac7-df770da3592c is not attached to volume 85856c7f-ed0d-46b1-befe-3881f94371a5 Oct 28 19:10:23.473779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:10:23.473779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:23.473779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:10:23.473779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:23.473779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:23.473779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:23.473779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:23.473779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:23.473779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be43ea5-02f7-43db-8ac7-df770da3592c is not attached to volume 85856c7f-ed0d-46b1-befe-3881f94371a5 Oct 28 19:10:23.473779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:10:23.473779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-571270de-55a7-4ad9-a5ce-1ae669391998 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Returning 404 to user: Instance 6be43ea5-02f7-43db-8ac7-df770da3592c is not attached to volume 85856c7f-ed0d-46b1-befe-3881f94371a5 {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:23.474868 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-571270de-55a7-4ad9-a5ce-1ae669391998 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c/os-volume_attachments/85856c7f-ed0d-46b1-befe-3881f94371a5" status: 404 len: 154 microversion: 2.1 time: 0.111698 Oct 28 19:10:23.474868 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 298/575] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Oct 28 19:10:23 2022] DELETE /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c/os-volume_attachments/85856c7f-ed0d-46b1-befe-3881f94371a5 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:10:23.476733 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-d8eabfe1-4400-4b48-82a5-24516f2e43df tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Action: 'create', calling method: .version_select at 0x7f9bf67e6940>, body: {"keypair": {"name": "tempest-keypair-158728537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYxfe6Zl7nr4p/2wLoYLffK6zzBljDFVqyuLGco9zUsGLgV4GixwNNOjPx8vZ8u0V+PRBqcbDaXHiaUpa1sstKOBx94d0twFJ3Knqveoh/lele8sWQtWapWoIiK0uKa/A=="}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:23.495163 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-d8eabfe1-4400-4b48-82a5-24516f2e43df tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Getting quotas for project 55bc75ee717c43b7811b0ab11c647f99. Resources: {'key_pairs'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:10:23.507290 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-d8eabfe1-4400-4b48-82a5-24516f2e43df tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Getting quotas for user e868bb74b33f467380562aec01a3d3e9 and project 55bc75ee717c43b7811b0ab11c647f99. Resources: {'key_pairs'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:10:23.511539 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:23.539873 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-d8eabfe1-4400-4b48-82a5-24516f2e43df tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.066590 Oct 28 19:10:23.540360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 299/576] 10.222.0.58 () {62 vars in 1200 bytes} [Fri Oct 28 19:10:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 19:10:23.620266 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-cd29a836-9e90-46a7-915e-c63ba5f3794d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:23.630079 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-cd29a836-9e90-46a7-915e-c63ba5f3794d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.220500 Oct 28 19:10:23.631133 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 278/577] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:23 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:24.328554 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-5854747d-d2e2-4c76-9279-c191c1202529 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:24.329157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-5854747d-d2e2-4c76-9279-c191c1202529 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:24.336020 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5854747d-d2e2-4c76-9279-c191c1202529 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:24.336505 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5854747d-d2e2-4c76-9279-c191c1202529 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:24.336941 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5854747d-d2e2-4c76-9279-c191c1202529 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:24.337641 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5854747d-d2e2-4c76-9279-c191c1202529 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:24.338084 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5854747d-d2e2-4c76-9279-c191c1202529 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:24.338501 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5854747d-d2e2-4c76-9279-c191c1202529 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:24.424006 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-713f379b-d692-4c63-9174-774a287589df tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:24.425308 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-713f379b-d692-4c63-9174-774a287589df tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:24.432098 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-713f379b-d692-4c63-9174-774a287589df tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:24.432578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-713f379b-d692-4c63-9174-774a287589df tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:24.433013 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-713f379b-d692-4c63-9174-774a287589df tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:24.433708 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-713f379b-d692-4c63-9174-774a287589df tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:24.434193 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-713f379b-d692-4c63-9174-774a287589df tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:24.434618 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-713f379b-d692-4c63-9174-774a287589df tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:24.566203 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-5854747d-d2e2-4c76-9279-c191c1202529 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:24.574326 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-5854747d-d2e2-4c76-9279-c191c1202529 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1313 microversion: 2.1 time: 0.249822 Oct 28 19:10:24.575141 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 300/578] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:24 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:24.633228 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-9a2ef66c-c522-425a-905b-ea559c2dff86 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:24.633807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-9a2ef66c-c522-425a-905b-ea559c2dff86 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:24.640030 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9a2ef66c-c522-425a-905b-ea559c2dff86 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:24.640603 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9a2ef66c-c522-425a-905b-ea559c2dff86 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:24.641104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9a2ef66c-c522-425a-905b-ea559c2dff86 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:24.641906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9a2ef66c-c522-425a-905b-ea559c2dff86 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:24.642353 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9a2ef66c-c522-425a-905b-ea559c2dff86 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:24.642769 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9a2ef66c-c522-425a-905b-ea559c2dff86 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:24.662441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-713f379b-d692-4c63-9174-774a287589df tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:24.667636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-9a2ef66c-c522-425a-905b-ea559c2dff86 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Going to try to terminate instance {{(pid=118874) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:10:24.671172 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-713f379b-d692-4c63-9174-774a287589df tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1678 microversion: 2.1 time: 0.251731 Oct 28 19:10:24.672256 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 279/579] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:24 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1678 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:24.692711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-90b45dd7-6491-4073-b2a4-d2646326e3ab tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:24.693499 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-90b45dd7-6491-4073-b2a4-d2646326e3ab tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:24.699498 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-90b45dd7-6491-4073-b2a4-d2646326e3ab tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:24.700077 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-90b45dd7-6491-4073-b2a4-d2646326e3ab tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:24.700598 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-90b45dd7-6491-4073-b2a4-d2646326e3ab tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:24.702061 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-90b45dd7-6491-4073-b2a4-d2646326e3ab tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:24.702664 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-90b45dd7-6491-4073-b2a4-d2646326e3ab tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:24.703541 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-90b45dd7-6491-4073-b2a4-d2646326e3ab tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:24.757669 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-9a2ef66c-c522-425a-905b-ea559c2dff86 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 204 len: 0 microversion: 2.1 time: 0.127969 Oct 28 19:10:24.758318 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 301/580] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Oct 28 19:10:24 2022] DELETE /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:10:24.768399 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-16a9e550-0547-4d2e-b3cf-c141648a42dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:24.769094 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-16a9e550-0547-4d2e-b3cf-c141648a42dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:24.775083 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-16a9e550-0547-4d2e-b3cf-c141648a42dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:24.775570 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-16a9e550-0547-4d2e-b3cf-c141648a42dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:24.776008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-16a9e550-0547-4d2e-b3cf-c141648a42dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:24.776701 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-16a9e550-0547-4d2e-b3cf-c141648a42dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:24.777295 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-16a9e550-0547-4d2e-b3cf-c141648a42dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:24.777727 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-16a9e550-0547-4d2e-b3cf-c141648a42dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.230256 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-90b45dd7-6491-4073-b2a4-d2646326e3ab tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:25.238842 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-90b45dd7-6491-4073-b2a4-d2646326e3ab tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.550283 Oct 28 19:10:25.251708 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 280/581] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:24 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:25.266010 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-c423a163-beba-4153-94db-82a5cdf3bddc req-2e5a45ab-dd38-42cf-bc45-759b5f0e7dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3994c112-84fe-4489-8f22-67ea315209d4", "name": "network-vif-plugged", "status": "completed", "tag": "a3a38617-7845-41ed-9a88-b13f0d396c88"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:25.272499 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-c423a163-beba-4153-94db-82a5cdf3bddc req-2e5a45ab-dd38-42cf-bc45-759b5f0e7dd3 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.273056 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-c423a163-beba-4153-94db-82a5cdf3bddc req-2e5a45ab-dd38-42cf-bc45-759b5f0e7dd3 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.273577 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-c423a163-beba-4153-94db-82a5cdf3bddc req-2e5a45ab-dd38-42cf-bc45-759b5f0e7dd3 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.275651 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-16a9e550-0547-4d2e-b3cf-c141648a42dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:25.285313 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-16a9e550-0547-4d2e-b3cf-c141648a42dc tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1553 microversion: 2.1 time: 0.522044 Oct 28 19:10:25.286289 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-c423a163-beba-4153-94db-82a5cdf3bddc req-2e5a45ab-dd38-42cf-bc45-759b5f0e7dd3 service nova] Creating event network-vif-plugged:a3a38617-7845-41ed-9a88-b13f0d396c88 for instance 3994c112-84fe-4489-8f22-67ea315209d4 on hv-cinder-86236 Oct 28 19:10:25.291239 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 302/582] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:24 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1553 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:25.297096 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-c423a163-beba-4153-94db-82a5cdf3bddc req-2e5a45ab-dd38-42cf-bc45-759b5f0e7dd3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044024 Oct 28 19:10:25.298110 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 281/583] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:25.358816 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-fe88b195-18d8-4449-87c3-6b38b4c6de4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-410931265", "imageRef": "cd92a575-ed0d-417b-b416-3471be3ba100", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76697f1b-3728-40eb-a4e4-fcc03821bebb"}], "security_groups": [{"name": "tempest-securitygroup--475099541"}], "key_name": "tempest-keypair-158728537", "user_data": "}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:25.458535 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.network.neutron [None req-fe88b195-18d8-4449-87c3-6b38b4c6de4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] validate_networks() for [('76697f1b-3728-40eb-a4e4-fcc03821bebb', None, None, None, None, None)] {{(pid=118874) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:10:25.599118 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-9612b8b8-02d0-4919-9c47-b23e7e77d2e2 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.599827 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-9612b8b8-02d0-4919-9c47-b23e7e77d2e2 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:25.605826 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9612b8b8-02d0-4919-9c47-b23e7e77d2e2 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.606305 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9612b8b8-02d0-4919-9c47-b23e7e77d2e2 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.606744 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9612b8b8-02d0-4919-9c47-b23e7e77d2e2 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.607455 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9612b8b8-02d0-4919-9c47-b23e7e77d2e2 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.607907 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9612b8b8-02d0-4919-9c47-b23e7e77d2e2 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.608330 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9612b8b8-02d0-4919-9c47-b23e7e77d2e2 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.824748 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-9612b8b8-02d0-4919-9c47-b23e7e77d2e2 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:25.833026 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-9612b8b8-02d0-4919-9c47-b23e7e77d2e2 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1313 microversion: 2.1 time: 0.238544 Oct 28 19:10:25.833776 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 282/584] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:25 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:25.843045 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b8519c7d-80dc-47f3-9fd5-39b1f5fc6ea5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.843045 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b8519c7d-80dc-47f3-9fd5-39b1f5fc6ea5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:25.843045 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_api:SELECT=83 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:25.846602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b8519c7d-80dc-47f3-9fd5-39b1f5fc6ea5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.847151 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b8519c7d-80dc-47f3-9fd5-39b1f5fc6ea5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.847553 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b8519c7d-80dc-47f3-9fd5-39b1f5fc6ea5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.848247 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b8519c7d-80dc-47f3-9fd5-39b1f5fc6ea5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.848699 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b8519c7d-80dc-47f3-9fd5-39b1f5fc6ea5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.849124 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b8519c7d-80dc-47f3-9fd5-39b1f5fc6ea5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.920623 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-fe88b195-18d8-4449-87c3-6b38b4c6de4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Flavor limits 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:10:25.921107 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-fe88b195-18d8-4449-87c3-6b38b4c6de4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Image limits 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:10:25.921638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-fe88b195-18d8-4449-87c3-6b38b4c6de4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Flavor pref 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:10:25.922683 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-fe88b195-18d8-4449-87c3-6b38b4c6de4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Image pref 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:10:25.923122 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-fe88b195-18d8-4449-87c3-6b38b4c6de4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:10:25.931709 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fe88b195-18d8-4449-87c3-6b38b4c6de4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.932183 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fe88b195-18d8-4449-87c3-6b38b4c6de4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.932640 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fe88b195-18d8-4449-87c3-6b38b4c6de4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.933357 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fe88b195-18d8-4449-87c3-6b38b4c6de4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.933798 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fe88b195-18d8-4449-87c3-6b38b4c6de4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.934215 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fe88b195-18d8-4449-87c3-6b38b4c6de4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.951393 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-fe88b195-18d8-4449-87c3-6b38b4c6de4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Getting quotas for project 55bc75ee717c43b7811b0ab11c647f99. Resources: {'ram', 'instances', 'cores'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:10:25.955590 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-fe88b195-18d8-4449-87c3-6b38b4c6de4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Getting quotas for user e868bb74b33f467380562aec01a3d3e9 and project 55bc75ee717c43b7811b0ab11c647f99. Resources: {'ram', 'instances', 'cores'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:10:25.966711 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-fe88b195-18d8-4449-87c3-6b38b4c6de4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Going to run 1 instances... {{(pid=118874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:10:25.969071 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-fe88b195-18d8-4449-87c3-6b38b4c6de4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd92a575-ed0d-417b-b416-3471be3ba100',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:10:25.989275 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b8519c7d-80dc-47f3-9fd5-39b1f5fc6ea5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:25.998069 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b8519c7d-80dc-47f3-9fd5-39b1f5fc6ea5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1678 microversion: 2.1 time: 0.163507 Oct 28 19:10:25.998636 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 283/585] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:25 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:26.022913 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-fe88b195-18d8-4449-87c3-6b38b4c6de4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.668327 Oct 28 19:10:26.023672 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 303/586] 10.222.0.58 () {62 vars in 1188 bytes} [Fri Oct 28 19:10:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 19:10:26.034894 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-ee58c102-c54a-4aa6-bdae-57e6ef452f9d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:26.035639 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-ee58c102-c54a-4aa6-bdae-57e6ef452f9d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:26.089144 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ee58c102-c54a-4aa6-bdae-57e6ef452f9d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:26.096451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ee58c102-c54a-4aa6-bdae-57e6ef452f9d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:26.098056 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ee58c102-c54a-4aa6-bdae-57e6ef452f9d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:26.099280 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-ee58c102-c54a-4aa6-bdae-57e6ef452f9d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1280 microversion: 2.20 time: 0.068377 Oct 28 19:10:26.099916 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 284/587] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:26 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:10:26.267804 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-21233c33-8698-490d-ad53-d3fa01ab6039 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:26.268441 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-21233c33-8698-490d-ad53-d3fa01ab6039 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:26.274532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-21233c33-8698-490d-ad53-d3fa01ab6039 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:26.275043 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-21233c33-8698-490d-ad53-d3fa01ab6039 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:26.275485 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-21233c33-8698-490d-ad53-d3fa01ab6039 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:26.276173 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-21233c33-8698-490d-ad53-d3fa01ab6039 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:26.276624 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-21233c33-8698-490d-ad53-d3fa01ab6039 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:26.277048 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-21233c33-8698-490d-ad53-d3fa01ab6039 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:26.308928 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-e55d7fbb-6e4f-43b8-b109-89117b86b3d8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:26.309652 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-e55d7fbb-6e4f-43b8-b109-89117b86b3d8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:26.315720 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e55d7fbb-6e4f-43b8-b109-89117b86b3d8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:26.316203 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e55d7fbb-6e4f-43b8-b109-89117b86b3d8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:26.316876 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e55d7fbb-6e4f-43b8-b109-89117b86b3d8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:26.317737 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e55d7fbb-6e4f-43b8-b109-89117b86b3d8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:26.318358 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e55d7fbb-6e4f-43b8-b109-89117b86b3d8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:26.318785 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e55d7fbb-6e4f-43b8-b109-89117b86b3d8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:26.509167 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-21233c33-8698-490d-ad53-d3fa01ab6039 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:26.515520 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-e55d7fbb-6e4f-43b8-b109-89117b86b3d8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:26.519520 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-21233c33-8698-490d-ad53-d3fa01ab6039 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.255647 Oct 28 19:10:26.521332 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 304/588] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:26 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:26.525711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-e55d7fbb-6e4f-43b8-b109-89117b86b3d8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1553 microversion: 2.1 time: 0.220631 Oct 28 19:10:26.526270 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 285/589] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:26 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1553 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:26.858539 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-73f58452-9bbd-482e-8c9b-d86f52ea4d23 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:26.859582 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-73f58452-9bbd-482e-8c9b-d86f52ea4d23 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:26.865885 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-73f58452-9bbd-482e-8c9b-d86f52ea4d23 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:26.866604 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-73f58452-9bbd-482e-8c9b-d86f52ea4d23 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:26.867066 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-73f58452-9bbd-482e-8c9b-d86f52ea4d23 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:26.867930 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-73f58452-9bbd-482e-8c9b-d86f52ea4d23 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:26.868572 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-73f58452-9bbd-482e-8c9b-d86f52ea4d23 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:26.869156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-73f58452-9bbd-482e-8c9b-d86f52ea4d23 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.022372 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d8743d82-51ea-4c41-b543-1a7dbee9ae39 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:27.022996 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d8743d82-51ea-4c41-b543-1a7dbee9ae39 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:27.029426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d8743d82-51ea-4c41-b543-1a7dbee9ae39 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.029916 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d8743d82-51ea-4c41-b543-1a7dbee9ae39 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.030358 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d8743d82-51ea-4c41-b543-1a7dbee9ae39 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.031105 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d8743d82-51ea-4c41-b543-1a7dbee9ae39 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.031555 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d8743d82-51ea-4c41-b543-1a7dbee9ae39 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.031990 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d8743d82-51ea-4c41-b543-1a7dbee9ae39 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.096010 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-73f58452-9bbd-482e-8c9b-d86f52ea4d23 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:27.103739 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-73f58452-9bbd-482e-8c9b-d86f52ea4d23 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1313 microversion: 2.1 time: 0.250160 Oct 28 19:10:27.104298 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 305/590] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:26 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:27.123802 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-cdccc3e1-5c66-47be-bb14-4631d7a0bbb9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:27.124408 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-cdccc3e1-5c66-47be-bb14-4631d7a0bbb9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:27.130737 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cdccc3e1-5c66-47be-bb14-4631d7a0bbb9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.131257 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cdccc3e1-5c66-47be-bb14-4631d7a0bbb9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.131710 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cdccc3e1-5c66-47be-bb14-4631d7a0bbb9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.132406 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cdccc3e1-5c66-47be-bb14-4631d7a0bbb9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.132853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cdccc3e1-5c66-47be-bb14-4631d7a0bbb9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.133275 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cdccc3e1-5c66-47be-bb14-4631d7a0bbb9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.225932 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-cdccc3e1-5c66-47be-bb14-4631d7a0bbb9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:27.233888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-cdccc3e1-5c66-47be-bb14-4631d7a0bbb9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:27.235407 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-cdccc3e1-5c66-47be-bb14-4631d7a0bbb9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:27.236522 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-cdccc3e1-5c66-47be-bb14-4631d7a0bbb9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1332 microversion: 2.20 time: 0.116515 Oct 28 19:10:27.237077 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 306/591] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:27 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:27.252872 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d8743d82-51ea-4c41-b543-1a7dbee9ae39 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:27.261018 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d8743d82-51ea-4c41-b543-1a7dbee9ae39 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1655 microversion: 2.1 time: 0.242560 Oct 28 19:10:27.261799 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 286/592] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:27 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1655 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:27.284039 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-0813e09d-c996-4819-89ab-e670ce0aefa0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:27.290097 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0813e09d-c996-4819-89ab-e670ce0aefa0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.290584 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0813e09d-c996-4819-89ab-e670ce0aefa0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.291049 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0813e09d-c996-4819-89ab-e670ce0aefa0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.321228 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-0813e09d-c996-4819-89ab-e670ce0aefa0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Going to try to start instance {{(pid=118874) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 19:10:27.352524 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-32a9f891-51bf-4e15-a851-da5eadb5386e req-5d4c7d1e-4fd8-4f86-ac81-8e45a54a09a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be43ea5-02f7-43db-8ac7-df770da3592c", "name": "network-vif-deleted", "tag": "6c0693d1-2c4b-4d7e-952e-42bbac4297f8"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:27.362369 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-32a9f891-51bf-4e15-a851-da5eadb5386e req-5d4c7d1e-4fd8-4f86-ac81-8e45a54a09a0 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.362865 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-32a9f891-51bf-4e15-a851-da5eadb5386e req-5d4c7d1e-4fd8-4f86-ac81-8e45a54a09a0 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.363320 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-32a9f891-51bf-4e15-a851-da5eadb5386e req-5d4c7d1e-4fd8-4f86-ac81-8e45a54a09a0 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.365296 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-0813e09d-c996-4819-89ab-e670ce0aefa0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "POST /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/action" status: 202 len: 0 microversion: 2.1 time: 0.085033 Oct 28 19:10:27.368980 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 307/593] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Oct 28 19:10:27 2022] POST /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:27.374256 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-e3736f14-d5e7-4af7-ae00-2801550d3177 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:27.375617 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-e3736f14-d5e7-4af7-ae00-2801550d3177 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:27.375952 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-32a9f891-51bf-4e15-a851-da5eadb5386e req-5d4c7d1e-4fd8-4f86-ac81-8e45a54a09a0 service nova] Creating event network-vif-deleted:6c0693d1-2c4b-4d7e-952e-42bbac4297f8 for instance 6be43ea5-02f7-43db-8ac7-df770da3592c on hv-cinder-86236 Oct 28 19:10:27.380785 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-32a9f891-51bf-4e15-a851-da5eadb5386e req-5d4c7d1e-4fd8-4f86-ac81-8e45a54a09a0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031792 Oct 28 19:10:27.381553 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 287/594] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:10:27.382345 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e3736f14-d5e7-4af7-ae00-2801550d3177 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.382823 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e3736f14-d5e7-4af7-ae00-2801550d3177 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.383352 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e3736f14-d5e7-4af7-ae00-2801550d3177 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.383976 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e3736f14-d5e7-4af7-ae00-2801550d3177 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.384428 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e3736f14-d5e7-4af7-ae00-2801550d3177 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.385116 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e3736f14-d5e7-4af7-ae00-2801550d3177 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.512889 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e3736f14-d5e7-4af7-ae00-2801550d3177 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:27.520614 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-e3736f14-d5e7-4af7-ae00-2801550d3177 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1664 microversion: 2.1 time: 0.150329 Oct 28 19:10:27.521179 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 308/595] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:27 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:27.550135 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-19180b34-8ef1-48cb-a863-9d74df89e76e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:27.550732 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-19180b34-8ef1-48cb-a863-9d74df89e76e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:27.552568 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-3915be3c-ef2b-4c7c-a54e-d67bb40d31b5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:27.553267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-3915be3c-ef2b-4c7c-a54e-d67bb40d31b5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:27.556644 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-19180b34-8ef1-48cb-a863-9d74df89e76e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.557128 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-19180b34-8ef1-48cb-a863-9d74df89e76e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.557560 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-19180b34-8ef1-48cb-a863-9d74df89e76e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.558249 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-19180b34-8ef1-48cb-a863-9d74df89e76e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.558737 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-19180b34-8ef1-48cb-a863-9d74df89e76e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.559212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-19180b34-8ef1-48cb-a863-9d74df89e76e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.560697 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3915be3c-ef2b-4c7c-a54e-d67bb40d31b5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.561163 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3915be3c-ef2b-4c7c-a54e-d67bb40d31b5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.561607 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3915be3c-ef2b-4c7c-a54e-d67bb40d31b5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.562303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3915be3c-ef2b-4c7c-a54e-d67bb40d31b5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.563440 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3915be3c-ef2b-4c7c-a54e-d67bb40d31b5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.563867 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3915be3c-ef2b-4c7c-a54e-d67bb40d31b5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.661163 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3915be3c-ef2b-4c7c-a54e-d67bb40d31b5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:27.671035 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-3915be3c-ef2b-4c7c-a54e-d67bb40d31b5 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1511 microversion: 2.1 time: 0.124955 Oct 28 19:10:27.672563 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 288/596] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:27 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1511 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:27.729221 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-19180b34-8ef1-48cb-a863-9d74df89e76e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:27.738311 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-19180b34-8ef1-48cb-a863-9d74df89e76e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.192438 Oct 28 19:10:27.738878 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 309/597] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:27 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:28.126254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d531dd1e-304f-437f-a6fa-005dba3c2097 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:28.127173 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d531dd1e-304f-437f-a6fa-005dba3c2097 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:28.133203 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d531dd1e-304f-437f-a6fa-005dba3c2097 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.133688 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d531dd1e-304f-437f-a6fa-005dba3c2097 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.134131 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d531dd1e-304f-437f-a6fa-005dba3c2097 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.135110 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d531dd1e-304f-437f-a6fa-005dba3c2097 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.135568 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d531dd1e-304f-437f-a6fa-005dba3c2097 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.135995 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d531dd1e-304f-437f-a6fa-005dba3c2097 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.262626 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-ca035345-ae70-4653-81b4-0a50ebd6666e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:28.263365 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-ca035345-ae70-4653-81b4-0a50ebd6666e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:28.267702 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d531dd1e-304f-437f-a6fa-005dba3c2097 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:28.269500 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ca035345-ae70-4653-81b4-0a50ebd6666e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.270178 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ca035345-ae70-4653-81b4-0a50ebd6666e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.270616 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ca035345-ae70-4653-81b4-0a50ebd6666e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.271327 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ca035345-ae70-4653-81b4-0a50ebd6666e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.271773 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ca035345-ae70-4653-81b4-0a50ebd6666e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.272191 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ca035345-ae70-4653-81b4-0a50ebd6666e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.278910 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d531dd1e-304f-437f-a6fa-005dba3c2097 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1463 microversion: 2.1 time: 0.156608 Oct 28 19:10:28.280184 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 289/598] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:28 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:28.326770 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-2cdb6322-8cb5-4fbd-ad3b-eebd2ccaa47d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:28.327387 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-2cdb6322-8cb5-4fbd-ad3b-eebd2ccaa47d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:28.333245 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2cdb6322-8cb5-4fbd-ad3b-eebd2ccaa47d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.333731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2cdb6322-8cb5-4fbd-ad3b-eebd2ccaa47d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.334465 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2cdb6322-8cb5-4fbd-ad3b-eebd2ccaa47d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.334868 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2cdb6322-8cb5-4fbd-ad3b-eebd2ccaa47d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.335351 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2cdb6322-8cb5-4fbd-ad3b-eebd2ccaa47d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.335774 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2cdb6322-8cb5-4fbd-ad3b-eebd2ccaa47d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.353138 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ca035345-ae70-4653-81b4-0a50ebd6666e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:28.361261 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-2cdb6322-8cb5-4fbd-ad3b-eebd2ccaa47d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Going to try to terminate instance {{(pid=118875) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:10:28.362546 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ca035345-ae70-4653-81b4-0a50ebd6666e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:28.364014 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ca035345-ae70-4653-81b4-0a50ebd6666e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:28.365179 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-ca035345-ae70-4653-81b4-0a50ebd6666e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1332 microversion: 2.20 time: 0.106737 Oct 28 19:10:28.365740 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 310/599] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:28 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:10:28.441016 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-2cdb6322-8cb5-4fbd-ad3b-eebd2ccaa47d tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 204 len: 0 microversion: 2.1 time: 0.117854 Oct 28 19:10:28.441864 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 290/600] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Oct 28 19:10:28 2022] DELETE /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:10:28.453922 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-9a9370c3-ac22-49d8-9ec7-4677a0454d13 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:28.454250 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-9a9370c3-ac22-49d8-9ec7-4677a0454d13 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:28.463428 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9a9370c3-ac22-49d8-9ec7-4677a0454d13 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.463944 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9a9370c3-ac22-49d8-9ec7-4677a0454d13 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.464457 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9a9370c3-ac22-49d8-9ec7-4677a0454d13 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.465064 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9a9370c3-ac22-49d8-9ec7-4677a0454d13 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.465508 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9a9370c3-ac22-49d8-9ec7-4677a0454d13 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.466010 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9a9370c3-ac22-49d8-9ec7-4677a0454d13 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.471129 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:28.545034 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-4f752424-ce0d-43a9-92dd-2640fd7b083c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:28.545771 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-4f752424-ce0d-43a9-92dd-2640fd7b083c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:28.552417 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4f752424-ce0d-43a9-92dd-2640fd7b083c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.552908 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4f752424-ce0d-43a9-92dd-2640fd7b083c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.553356 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4f752424-ce0d-43a9-92dd-2640fd7b083c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.554057 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4f752424-ce0d-43a9-92dd-2640fd7b083c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.554514 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4f752424-ce0d-43a9-92dd-2640fd7b083c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.554945 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4f752424-ce0d-43a9-92dd-2640fd7b083c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.633916 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-9a9370c3-ac22-49d8-9ec7-4677a0454d13 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:28.642833 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-9a9370c3-ac22-49d8-9ec7-4677a0454d13 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1469 microversion: 2.1 time: 0.196580 Oct 28 19:10:28.643477 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 311/601] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:28 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1469 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:28.696329 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-b82c3abd-b11c-406d-b63c-3e5066e60a82 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:28.696970 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-b82c3abd-b11c-406d-b63c-3e5066e60a82 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:28.697369 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-4f752424-ce0d-43a9-92dd-2640fd7b083c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:28.702876 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b82c3abd-b11c-406d-b63c-3e5066e60a82 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.703392 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b82c3abd-b11c-406d-b63c-3e5066e60a82 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.703829 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b82c3abd-b11c-406d-b63c-3e5066e60a82 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.704520 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b82c3abd-b11c-406d-b63c-3e5066e60a82 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.705019 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-4f752424-ce0d-43a9-92dd-2640fd7b083c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1664 microversion: 2.1 time: 0.164242 Oct 28 19:10:28.705584 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 291/602] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:28 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:28.705759 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b82c3abd-b11c-406d-b63c-3e5066e60a82 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.706031 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b82c3abd-b11c-406d-b63c-3e5066e60a82 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.736882 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b82c3abd-b11c-406d-b63c-3e5066e60a82 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.737382 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b82c3abd-b11c-406d-b63c-3e5066e60a82 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.737815 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b82c3abd-b11c-406d-b63c-3e5066e60a82 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.738257 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.objects.instance [None req-b82c3abd-b11c-406d-b63c-3e5066e60a82 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lazy-loading 'fault' on Instance uuid 6be43ea5-02f7-43db-8ac7-df770da3592c {{(pid=118874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:28.762460 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-1b3a7913-27c6-4014-858f-b3d6f6a4996a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:28.763256 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-1b3a7913-27c6-4014-858f-b3d6f6a4996a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:28.778318 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-b82c3abd-b11c-406d-b63c-3e5066e60a82 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:28.781953 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1b3a7913-27c6-4014-858f-b3d6f6a4996a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.782454 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1b3a7913-27c6-4014-858f-b3d6f6a4996a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.782889 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1b3a7913-27c6-4014-858f-b3d6f6a4996a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.783612 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1b3a7913-27c6-4014-858f-b3d6f6a4996a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.784064 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1b3a7913-27c6-4014-858f-b3d6f6a4996a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.784488 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1b3a7913-27c6-4014-858f-b3d6f6a4996a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.786708 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-b82c3abd-b11c-406d-b63c-3e5066e60a82 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1346 microversion: 2.1 time: 0.094263 Oct 28 19:10:28.787325 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 312/603] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:28 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:28.911198 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1b3a7913-27c6-4014-858f-b3d6f6a4996a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:28.919454 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-1b3a7913-27c6-4014-858f-b3d6f6a4996a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.161192 Oct 28 19:10:28.920018 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 292/604] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:28 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:29.389951 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-903f0eae-85ea-4a45-8ae8-4d6743b3578f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:29.390584 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-903f0eae-85ea-4a45-8ae8-4d6743b3578f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:29.396501 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-903f0eae-85ea-4a45-8ae8-4d6743b3578f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:29.396978 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-903f0eae-85ea-4a45-8ae8-4d6743b3578f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:29.397414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-903f0eae-85ea-4a45-8ae8-4d6743b3578f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:29.398098 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-903f0eae-85ea-4a45-8ae8-4d6743b3578f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:29.398545 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-903f0eae-85ea-4a45-8ae8-4d6743b3578f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:29.398965 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-903f0eae-85ea-4a45-8ae8-4d6743b3578f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:29.462374 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-903f0eae-85ea-4a45-8ae8-4d6743b3578f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:29.470873 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-903f0eae-85ea-4a45-8ae8-4d6743b3578f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:29.472341 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-903f0eae-85ea-4a45-8ae8-4d6743b3578f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:29.473427 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-903f0eae-85ea-4a45-8ae8-4d6743b3578f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1332 microversion: 2.20 time: 0.087447 Oct 28 19:10:29.474048 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 313/605] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:29 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1332 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:10:29.666590 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-8677280f-1f43-4c00-b49a-ca2f8cbb51d9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:29.667217 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-8677280f-1f43-4c00-b49a-ca2f8cbb51d9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:29.673650 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8677280f-1f43-4c00-b49a-ca2f8cbb51d9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:29.674128 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8677280f-1f43-4c00-b49a-ca2f8cbb51d9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:29.674562 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8677280f-1f43-4c00-b49a-ca2f8cbb51d9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:29.675278 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8677280f-1f43-4c00-b49a-ca2f8cbb51d9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:29.675730 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8677280f-1f43-4c00-b49a-ca2f8cbb51d9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:29.676153 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8677280f-1f43-4c00-b49a-ca2f8cbb51d9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:29.728084 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-5c0dae56-96f7-4646-a0ff-ec29c811bb6d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:29.728707 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-5c0dae56-96f7-4646-a0ff-ec29c811bb6d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:29.734878 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c0dae56-96f7-4646-a0ff-ec29c811bb6d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:29.735412 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c0dae56-96f7-4646-a0ff-ec29c811bb6d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:29.735840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c0dae56-96f7-4646-a0ff-ec29c811bb6d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:29.736527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c0dae56-96f7-4646-a0ff-ec29c811bb6d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:29.736967 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c0dae56-96f7-4646-a0ff-ec29c811bb6d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:29.737384 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c0dae56-96f7-4646-a0ff-ec29c811bb6d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:29.851360 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-8677280f-1f43-4c00-b49a-ca2f8cbb51d9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:29.859428 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-8677280f-1f43-4c00-b49a-ca2f8cbb51d9 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1469 microversion: 2.1 time: 0.196584 Oct 28 19:10:29.869433 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 293/606] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:29 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1469 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:29.869433 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-74c1ac41-37e7-40f8-a556-8ece4a7419eb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:29.869433 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-74c1ac41-37e7-40f8-a556-8ece4a7419eb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:29.873452 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74c1ac41-37e7-40f8-a556-8ece4a7419eb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:29.873945 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74c1ac41-37e7-40f8-a556-8ece4a7419eb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:29.875014 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74c1ac41-37e7-40f8-a556-8ece4a7419eb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:29.877257 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74c1ac41-37e7-40f8-a556-8ece4a7419eb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:29.877257 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74c1ac41-37e7-40f8-a556-8ece4a7419eb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:29.877257 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74c1ac41-37e7-40f8-a556-8ece4a7419eb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:29.914664 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74c1ac41-37e7-40f8-a556-8ece4a7419eb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:29.915101 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74c1ac41-37e7-40f8-a556-8ece4a7419eb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:29.915541 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74c1ac41-37e7-40f8-a556-8ece4a7419eb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:29.915986 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.objects.instance [None req-74c1ac41-37e7-40f8-a556-8ece4a7419eb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lazy-loading 'fault' on Instance uuid 6be43ea5-02f7-43db-8ac7-df770da3592c {{(pid=118875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:29.918765 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:29.929039 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-5c0dae56-96f7-4646-a0ff-ec29c811bb6d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:29.937672 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-5c0dae56-96f7-4646-a0ff-ec29c811bb6d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1664 microversion: 2.1 time: 0.213255 Oct 28 19:10:29.951003 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 314/607] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:29 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1664 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:29.951003 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-2db338ea-102e-42bd-af78-5f4cccbce757 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:29.951003 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-2db338ea-102e-42bd-af78-5f4cccbce757 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:29.951003 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2db338ea-102e-42bd-af78-5f4cccbce757 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:29.951456 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2db338ea-102e-42bd-af78-5f4cccbce757 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:29.951456 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2db338ea-102e-42bd-af78-5f4cccbce757 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:29.951456 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2db338ea-102e-42bd-af78-5f4cccbce757 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:29.951456 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2db338ea-102e-42bd-af78-5f4cccbce757 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:29.951795 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2db338ea-102e-42bd-af78-5f4cccbce757 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:29.957484 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-74c1ac41-37e7-40f8-a556-8ece4a7419eb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:29.965654 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-74c1ac41-37e7-40f8-a556-8ece4a7419eb tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1346 microversion: 2.1 time: 0.104695 Oct 28 19:10:29.966415 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 294/608] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:29 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:30.144194 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-2db338ea-102e-42bd-af78-5f4cccbce757 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:30.152575 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-2db338ea-102e-42bd-af78-5f4cccbce757 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.213217 Oct 28 19:10:30.153140 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 315/609] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:29 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:30.498395 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-3869ec3e-0036-4e90-902c-7e6168694606 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:30.499153 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-3869ec3e-0036-4e90-902c-7e6168694606 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:30.505874 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3869ec3e-0036-4e90-902c-7e6168694606 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:30.506360 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3869ec3e-0036-4e90-902c-7e6168694606 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:30.506800 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3869ec3e-0036-4e90-902c-7e6168694606 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:30.507517 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3869ec3e-0036-4e90-902c-7e6168694606 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:30.507965 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3869ec3e-0036-4e90-902c-7e6168694606 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:30.508389 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3869ec3e-0036-4e90-902c-7e6168694606 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:30.573290 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3869ec3e-0036-4e90-902c-7e6168694606 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:30.582807 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3869ec3e-0036-4e90-902c-7e6168694606 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:30.584477 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3869ec3e-0036-4e90-902c-7e6168694606 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:30.585796 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-3869ec3e-0036-4e90-902c-7e6168694606 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1338 microversion: 2.20 time: 0.091110 Oct 28 19:10:30.586688 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 295/610] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:30 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1338 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:30.882037 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-d38ac7f6-6a11-476f-8cbe-dd6c08fea1ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:30.882786 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-d38ac7f6-6a11-476f-8cbe-dd6c08fea1ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:30.889018 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d38ac7f6-6a11-476f-8cbe-dd6c08fea1ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:30.889676 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d38ac7f6-6a11-476f-8cbe-dd6c08fea1ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:30.890371 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d38ac7f6-6a11-476f-8cbe-dd6c08fea1ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:30.890975 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d38ac7f6-6a11-476f-8cbe-dd6c08fea1ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:30.891629 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d38ac7f6-6a11-476f-8cbe-dd6c08fea1ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:30.892237 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d38ac7f6-6a11-476f-8cbe-dd6c08fea1ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:30.963045 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-74c4d324-8ec4-4b30-ad6e-257f89c787b9 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:30.965758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-74c4d324-8ec4-4b30-ad6e-257f89c787b9 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:30.983522 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-d38ac7f6-6a11-476f-8cbe-dd6c08fea1ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:30.996203 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74c4d324-8ec4-4b30-ad6e-257f89c787b9 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:30.999479 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74c4d324-8ec4-4b30-ad6e-257f89c787b9 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:31.002143 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74c4d324-8ec4-4b30-ad6e-257f89c787b9 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:31.003550 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74c4d324-8ec4-4b30-ad6e-257f89c787b9 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:31.004696 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-d38ac7f6-6a11-476f-8cbe-dd6c08fea1ce tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1427 microversion: 2.1 time: 0.126532 Oct 28 19:10:31.004985 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74c4d324-8ec4-4b30-ad6e-257f89c787b9 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:31.005631 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-74c4d324-8ec4-4b30-ad6e-257f89c787b9 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:31.008795 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 316/611] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:30 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1427 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:31.018073 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-669462c1-574f-4649-9cce-362ed50888f8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:31.018776 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-669462c1-574f-4649-9cce-362ed50888f8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:31.044501 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-669462c1-574f-4649-9cce-362ed50888f8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:31.045041 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-669462c1-574f-4649-9cce-362ed50888f8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:31.045824 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-669462c1-574f-4649-9cce-362ed50888f8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:31.047517 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-669462c1-574f-4649-9cce-362ed50888f8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:31.048290 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-669462c1-574f-4649-9cce-362ed50888f8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:31.049658 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-669462c1-574f-4649-9cce-362ed50888f8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:31.094494 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-669462c1-574f-4649-9cce-362ed50888f8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:31.095181 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-669462c1-574f-4649-9cce-362ed50888f8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:31.095825 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-669462c1-574f-4649-9cce-362ed50888f8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:31.096556 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.objects.instance [None req-669462c1-574f-4649-9cce-362ed50888f8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lazy-loading 'fault' on Instance uuid 6be43ea5-02f7-43db-8ac7-df770da3592c {{(pid=118874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:31.154972 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-669462c1-574f-4649-9cce-362ed50888f8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec54d8c1ea24cc8bbbeb6fef1fd2028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbb7ba7f14bd9bcaaa0ea461322a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:31.164220 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-669462c1-574f-4649-9cce-362ed50888f8 tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 200 len: 1346 microversion: 2.1 time: 0.153865 Oct 28 19:10:31.165316 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 317/612] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:31 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 1346 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:31.172037 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-d780ba5b-ce45-47cb-a613-17c2464ce7dc req-42eb6d54-e3c7-4bdf-84ca-450ebf3bc364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3994c112-84fe-4489-8f22-67ea315209d4", "name": "network-vif-deleted", "tag": "a3a38617-7845-41ed-9a88-b13f0d396c88"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:31.183005 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-d780ba5b-ce45-47cb-a613-17c2464ce7dc req-42eb6d54-e3c7-4bdf-84ca-450ebf3bc364 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:31.184158 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-d780ba5b-ce45-47cb-a613-17c2464ce7dc req-42eb6d54-e3c7-4bdf-84ca-450ebf3bc364 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:31.184593 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-d780ba5b-ce45-47cb-a613-17c2464ce7dc req-42eb6d54-e3c7-4bdf-84ca-450ebf3bc364 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:31.196768 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-d780ba5b-ce45-47cb-a613-17c2464ce7dc req-42eb6d54-e3c7-4bdf-84ca-450ebf3bc364 service nova] Creating event network-vif-deleted:a3a38617-7845-41ed-9a88-b13f0d396c88 for instance 3994c112-84fe-4489-8f22-67ea315209d4 on hv-cinder-86236 Oct 28 19:10:31.201761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-d780ba5b-ce45-47cb-a613-17c2464ce7dc req-42eb6d54-e3c7-4bdf-84ca-450ebf3bc364 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034982 Oct 28 19:10:31.202348 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 318/613] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:31.208730 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1c135db1-18cf-4440-97f2-39cea18f1f60 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:31.209488 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-1c135db1-18cf-4440-97f2-39cea18f1f60 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:31.216376 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1c135db1-18cf-4440-97f2-39cea18f1f60 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:31.216937 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1c135db1-18cf-4440-97f2-39cea18f1f60 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:31.217382 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1c135db1-18cf-4440-97f2-39cea18f1f60 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:31.218077 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1c135db1-18cf-4440-97f2-39cea18f1f60 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:31.219295 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1c135db1-18cf-4440-97f2-39cea18f1f60 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:31.219795 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1c135db1-18cf-4440-97f2-39cea18f1f60 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:31.227213 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-74c4d324-8ec4-4b30-ad6e-257f89c787b9 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:31.237388 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-74c4d324-8ec4-4b30-ad6e-257f89c787b9 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1668 microversion: 2.1 time: 0.279234 Oct 28 19:10:31.237975 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 296/614] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:30 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1668 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:31.350893 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-1c135db1-18cf-4440-97f2-39cea18f1f60 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:31.360889 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-1c135db1-18cf-4440-97f2-39cea18f1f60 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.156586 Oct 28 19:10:31.364648 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 319/615] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:31 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:31.612552 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-083699d7-1672-4c44-b21f-3d753376d2e6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:31.613432 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-083699d7-1672-4c44-b21f-3d753376d2e6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:31.619574 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-083699d7-1672-4c44-b21f-3d753376d2e6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:31.620057 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-083699d7-1672-4c44-b21f-3d753376d2e6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:31.620497 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-083699d7-1672-4c44-b21f-3d753376d2e6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:31.622018 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-083699d7-1672-4c44-b21f-3d753376d2e6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:31.622235 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-083699d7-1672-4c44-b21f-3d753376d2e6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:31.622786 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-083699d7-1672-4c44-b21f-3d753376d2e6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:31.783934 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-083699d7-1672-4c44-b21f-3d753376d2e6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:31.794366 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-083699d7-1672-4c44-b21f-3d753376d2e6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:31.797089 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-083699d7-1672-4c44-b21f-3d753376d2e6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:31.798155 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-083699d7-1672-4c44-b21f-3d753376d2e6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1405 microversion: 2.20 time: 0.190032 Oct 28 19:10:31.803083 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 297/616] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:31 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:32.037561 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4db5d158-3ea2-41b4-b1a0-0077606cf923 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:32.038306 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-4db5d158-3ea2-41b4-b1a0-0077606cf923 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:32.044163 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4db5d158-3ea2-41b4-b1a0-0077606cf923 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:32.044642 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4db5d158-3ea2-41b4-b1a0-0077606cf923 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:32.045079 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4db5d158-3ea2-41b4-b1a0-0077606cf923 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:32.045766 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4db5d158-3ea2-41b4-b1a0-0077606cf923 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:32.046214 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4db5d158-3ea2-41b4-b1a0-0077606cf923 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:32.046642 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4db5d158-3ea2-41b4-b1a0-0077606cf923 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:32.079868 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4db5d158-3ea2-41b4-b1a0-0077606cf923 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:32.080265 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4db5d158-3ea2-41b4-b1a0-0077606cf923 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:32.080928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4db5d158-3ea2-41b4-b1a0-0077606cf923 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:32.081135 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.objects.instance [None req-4db5d158-3ea2-41b4-b1a0-0077606cf923 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lazy-loading 'fault' on Instance uuid 3994c112-84fe-4489-8f22-67ea315209d4 {{(pid=118874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:32.124878 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4db5d158-3ea2-41b4-b1a0-0077606cf923 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d69e5a88004926904fd83cd63cc61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbac7c759b264dba88f7cb7b899cd360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:32.133047 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-4db5d158-3ea2-41b4-b1a0-0077606cf923 tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 200 len: 1303 microversion: 2.1 time: 0.099297 Oct 28 19:10:32.134052 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 320/617] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:32 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:32.188883 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-22a46af1-b964-4ca2-b184-96e47e59799b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:32.189490 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-22a46af1-b964-4ca2-b184-96e47e59799b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] [instance: 6be43ea5-02f7-43db-8ac7-df770da3592c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:32.196281 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-22a46af1-b964-4ca2-b184-96e47e59799b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:32.196978 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-22a46af1-b964-4ca2-b184-96e47e59799b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:32.197830 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-22a46af1-b964-4ca2-b184-96e47e59799b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:32.198856 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-22a46af1-b964-4ca2-b184-96e47e59799b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:32.199330 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-22a46af1-b964-4ca2-b184-96e47e59799b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:32.199751 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-22a46af1-b964-4ca2-b184-96e47e59799b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:32.215024 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.wsgi [None req-22a46af1-b964-4ca2-b184-96e47e59799b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] HTTP exception thrown: Instance 6be43ea5-02f7-43db-8ac7-df770da3592c could not be found. Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-22a46af1-b964-4ca2-b184-96e47e59799b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Request method failure captured: Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: request: GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c HTTP/1.1 Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept: application/json Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept-Encoding: identity Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Connection: close Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Length: 0 Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Type: application/json Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Host: 10.222.0.58 Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Openstack-System-Scope: None Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Auth-Token: gAAAAABjXChpze1BrO8eFwL9TgYucKdSToPPCJZ0vg80CMNatNl8HD6tSljN5Z_1-sAQ--UV-O5lYgwx9lyOQT6uY9u8GY0bzF3k-Q2tBkw038zdBhj_Ft1f3Q0V_VM5RRd3F_oeqGYJmkWK8N9jtGEvXg3U73EE9zKXEyeuTSGXo1HkPXnFnl8 Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Id: None Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Name: None Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Identity-Status: Confirmed Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Is-Admin-Project: True Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Id: default Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Name: Default Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Id: aa4bbb7ba7f14bd9bcaaa0ea461322a6 Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Name: tempest-TestMinimumBasicScenario-932109065 Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Role: member,reader Oct 28 19:10:32.216663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Roles: member,reader Oct 28 19:10:32.218055 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aa4bbb7ba7f14bd9bcaaa0ea461322a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aa4bbb7ba7f14bd9bcaaa0ea461322a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/aa4bbb7ba7f14bd9bcaaa0ea461322a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_aa4bbb7ba7f14bd9bcaaa0ea461322a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:10:32.218055 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant: tempest-TestMinimumBasicScenario-932109065 Oct 28 19:10:32.218055 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Id: aa4bbb7ba7f14bd9bcaaa0ea461322a6 Oct 28 19:10:32.218055 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Name: tempest-TestMinimumBasicScenario-932109065 Oct 28 19:10:32.218055 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User: tempest-TestMinimumBasicScenario-932109065-project Oct 28 19:10:32.218055 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Id: default Oct 28 19:10:32.218055 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Name: Default Oct 28 19:10:32.218055 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Id: fec54d8c1ea24cc8bbbeb6fef1fd2028 Oct 28 19:10:32.218055 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Name: tempest-TestMinimumBasicScenario-932109065-project Oct 28 19:10:32.218055 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: method: > Oct 28 19:10:32.218055 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: exception: Instance 6be43ea5-02f7-43db-8ac7-df770da3592c could not be found. Oct 28 19:10:32.218055 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: action_args: {'id': '6be43ea5-02f7-43db-8ac7-df770da3592c'} Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be43ea5-02f7-43db-8ac7-df770da3592c could not be found. Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:32.219451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:32.220622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:32.220622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:10:32.220622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:10:32.220622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:10:32.220622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:10:32.220622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:10:32.220622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:10:32.220622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be43ea5-02f7-43db-8ac7-df770da3592c could not be found. Oct 28 19:10:32.220622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:10:32.220622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:32.220622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:10:32.220622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:32.220622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:32.220622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:32.220622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:32.220622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:32.220622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be43ea5-02f7-43db-8ac7-df770da3592c could not be found. Oct 28 19:10:32.220622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:10:32.222628 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-22a46af1-b964-4ca2-b184-96e47e59799b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Returning 404 to user: Instance 6be43ea5-02f7-43db-8ac7-df770da3592c could not be found. {{(pid=118875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:32.223703 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-22a46af1-b964-4ca2-b184-96e47e59799b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c" status: 404 len: 111 microversion: 2.1 time: 0.039733 Oct 28 19:10:32.224665 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 298/618] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:32 2022] GET /compute/v2.1/servers/6be43ea5-02f7-43db-8ac7-df770da3592c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:10:32.236283 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-df780ea6-fdb4-4c91-9dbe-52e847913d4b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] Calling method '.version_select at 0x7f9bf6a90a60>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:32.255656 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-df780ea6-fdb4-4c91-9dbe-52e847913d4b tempest-TestMinimumBasicScenario-932109065 tempest-TestMinimumBasicScenario-932109065-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-221307694" status: 202 len: 0 microversion: 2.1 time: 0.025577 Oct 28 19:10:32.256228 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 321/619] 10.222.0.58 () {58 vars in 1269 bytes} [Fri Oct 28 19:10:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-221307694 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:32.386210 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-a4644d06-2d8a-4ab6-9b74-805e3a0309d0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:32.386764 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-a4644d06-2d8a-4ab6-9b74-805e3a0309d0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:32.393504 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a4644d06-2d8a-4ab6-9b74-805e3a0309d0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:32.393994 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a4644d06-2d8a-4ab6-9b74-805e3a0309d0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:32.394565 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a4644d06-2d8a-4ab6-9b74-805e3a0309d0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:32.395531 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a4644d06-2d8a-4ab6-9b74-805e3a0309d0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:32.396146 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a4644d06-2d8a-4ab6-9b74-805e3a0309d0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:32.396581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a4644d06-2d8a-4ab6-9b74-805e3a0309d0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:32.544447 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a4644d06-2d8a-4ab6-9b74-805e3a0309d0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:32.553457 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-a4644d06-2d8a-4ab6-9b74-805e3a0309d0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.171688 Oct 28 19:10:32.554017 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 299/620] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:32 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:32.823211 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-48fe3e12-d6e9-4827-be13-7ba5668e3125 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:32.823935 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-48fe3e12-d6e9-4827-be13-7ba5668e3125 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:32.830135 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-48fe3e12-d6e9-4827-be13-7ba5668e3125 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:32.830740 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-48fe3e12-d6e9-4827-be13-7ba5668e3125 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:32.831315 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-48fe3e12-d6e9-4827-be13-7ba5668e3125 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:32.832098 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-48fe3e12-d6e9-4827-be13-7ba5668e3125 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:32.832631 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-48fe3e12-d6e9-4827-be13-7ba5668e3125 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:32.833148 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-48fe3e12-d6e9-4827-be13-7ba5668e3125 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:32.970729 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-48fe3e12-d6e9-4827-be13-7ba5668e3125 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:32.982470 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-48fe3e12-d6e9-4827-be13-7ba5668e3125 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:32.984665 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-48fe3e12-d6e9-4827-be13-7ba5668e3125 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:32.986100 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-48fe3e12-d6e9-4827-be13-7ba5668e3125 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1405 microversion: 2.20 time: 0.166935 Oct 28 19:10:32.986662 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 322/621] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:32 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:33.157905 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-65be084d-5c6e-4eb6-8cca-3f47b92a92bc tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:33.158448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-65be084d-5c6e-4eb6-8cca-3f47b92a92bc tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] [instance: 3994c112-84fe-4489-8f22-67ea315209d4] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:33.164625 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-65be084d-5c6e-4eb6-8cca-3f47b92a92bc tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:33.165115 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-65be084d-5c6e-4eb6-8cca-3f47b92a92bc tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:33.165553 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-65be084d-5c6e-4eb6-8cca-3f47b92a92bc tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:33.166408 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-65be084d-5c6e-4eb6-8cca-3f47b92a92bc tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:33.167048 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-65be084d-5c6e-4eb6-8cca-3f47b92a92bc tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:33.167477 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-65be084d-5c6e-4eb6-8cca-3f47b92a92bc tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:33.181229 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.wsgi [None req-65be084d-5c6e-4eb6-8cca-3f47b92a92bc tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] HTTP exception thrown: Instance 3994c112-84fe-4489-8f22-67ea315209d4 could not be found. Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-65be084d-5c6e-4eb6-8cca-3f47b92a92bc tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Request method failure captured: Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: request: GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 HTTP/1.1 Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept: application/json Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept-Encoding: identity Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Connection: close Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Length: 0 Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Type: application/json Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Host: 10.222.0.58 Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Openstack-System-Scope: None Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Auth-Token: gAAAAABjXCkJL68kdYqqpx2QRLQE5N-Ia3doEXhI_L1jwtkATpQ-DVYICRKQIc0L9iHN-rzdEfQGutyVfkT6liA-cHmeBvDv0lX-So4DRHTWGMEDD8hznGR2rC-FPXICmBQPGuIMAMhNs931fpS6wPOI6Fxi_uhp3bDUDShlcJk3v9au3Bmjrbs Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Id: None Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Name: None Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Identity-Status: Confirmed Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Is-Admin-Project: True Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Id: default Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Name: Default Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Id: bbac7c759b264dba88f7cb7b899cd360 Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Name: tempest-VolumesNegativeTest-151945497 Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Role: member,reader Oct 28 19:10:33.182747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Roles: member,reader Oct 28 19:10:33.184084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bbac7c759b264dba88f7cb7b899cd360"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bbac7c759b264dba88f7cb7b899cd360"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bbac7c759b264dba88f7cb7b899cd360"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bbac7c759b264dba88f7cb7b899cd360"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:10:33.184084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant: tempest-VolumesNegativeTest-151945497 Oct 28 19:10:33.184084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Id: bbac7c759b264dba88f7cb7b899cd360 Oct 28 19:10:33.184084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Name: tempest-VolumesNegativeTest-151945497 Oct 28 19:10:33.184084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User: tempest-VolumesNegativeTest-151945497-project Oct 28 19:10:33.184084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Id: default Oct 28 19:10:33.184084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Name: Default Oct 28 19:10:33.184084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Id: 91d69e5a88004926904fd83cd63cc61b Oct 28 19:10:33.184084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Name: tempest-VolumesNegativeTest-151945497-project Oct 28 19:10:33.184084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: method: > Oct 28 19:10:33.184084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: exception: Instance 3994c112-84fe-4489-8f22-67ea315209d4 could not be found. Oct 28 19:10:33.184084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: action_args: {'id': '3994c112-84fe-4489-8f22-67ea315209d4'} Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3994c112-84fe-4489-8f22-67ea315209d4 could not be found. Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:33.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:33.185924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:33.185924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:10:33.185924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:10:33.185924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:10:33.185924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:10:33.185924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:10:33.185924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:10:33.185924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3994c112-84fe-4489-8f22-67ea315209d4 could not be found. Oct 28 19:10:33.185924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:10:33.185924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:33.185924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:10:33.185924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:33.185924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:33.185924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:33.185924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:33.185924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:33.185924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3994c112-84fe-4489-8f22-67ea315209d4 could not be found. Oct 28 19:10:33.185924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:10:33.187117 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-65be084d-5c6e-4eb6-8cca-3f47b92a92bc tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] Returning 404 to user: Instance 3994c112-84fe-4489-8f22-67ea315209d4 could not be found. {{(pid=118875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:33.187117 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-65be084d-5c6e-4eb6-8cca-3f47b92a92bc tempest-VolumesNegativeTest-151945497 tempest-VolumesNegativeTest-151945497-project] 10.222.0.58 "GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4" status: 404 len: 111 microversion: 2.1 time: 0.030900 Oct 28 19:10:33.187117 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 300/622] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:33 2022] GET /compute/v2.1/servers/3994c112-84fe-4489-8f22-67ea315209d4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:10:33.224622 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-c1f80a36-d61a-409a-bfe1-8952b8cab1da req-15da1d14-23de-4992-84e9-558ea8970379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c2187f-f4f1-4d25-96ff-2b032986f8b1", "tag": "b53160b4-c25e-42f7-a698-ec959ecf8b6d"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:33.233911 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-c1f80a36-d61a-409a-bfe1-8952b8cab1da req-15da1d14-23de-4992-84e9-558ea8970379 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:33.235000 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-c1f80a36-d61a-409a-bfe1-8952b8cab1da req-15da1d14-23de-4992-84e9-558ea8970379 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:33.235503 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-c1f80a36-d61a-409a-bfe1-8952b8cab1da req-15da1d14-23de-4992-84e9-558ea8970379 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:33.246258 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-c1f80a36-d61a-409a-bfe1-8952b8cab1da req-15da1d14-23de-4992-84e9-558ea8970379 service nova] Creating event network-changed:b53160b4-c25e-42f7-a698-ec959ecf8b6d for instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 on hv-cinder-86236 Oct 28 19:10:33.251738 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-c1f80a36-d61a-409a-bfe1-8952b8cab1da req-15da1d14-23de-4992-84e9-558ea8970379 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030463 Oct 28 19:10:33.252396 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 323/623] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:33.577079 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-0b0ba028-d80b-4600-a0bf-a42fe96f49c3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:33.578715 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-0b0ba028-d80b-4600-a0bf-a42fe96f49c3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:33.585542 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0b0ba028-d80b-4600-a0bf-a42fe96f49c3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:33.586265 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0b0ba028-d80b-4600-a0bf-a42fe96f49c3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:33.586867 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0b0ba028-d80b-4600-a0bf-a42fe96f49c3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:33.587747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0b0ba028-d80b-4600-a0bf-a42fe96f49c3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:33.588378 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0b0ba028-d80b-4600-a0bf-a42fe96f49c3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:33.588955 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0b0ba028-d80b-4600-a0bf-a42fe96f49c3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:33.727834 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-0b0ba028-d80b-4600-a0bf-a42fe96f49c3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:33.740035 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-0b0ba028-d80b-4600-a0bf-a42fe96f49c3 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.166690 Oct 28 19:10:33.740601 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 301/624] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:33 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:34.011285 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-d1d2de42-e905-4072-852a-a03737ade5f7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:34.011991 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-d1d2de42-e905-4072-852a-a03737ade5f7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:34.024672 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d1d2de42-e905-4072-852a-a03737ade5f7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:34.025046 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d1d2de42-e905-4072-852a-a03737ade5f7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:34.025486 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d1d2de42-e905-4072-852a-a03737ade5f7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:34.026261 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d1d2de42-e905-4072-852a-a03737ade5f7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:34.030398 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d1d2de42-e905-4072-852a-a03737ade5f7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:34.031298 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d1d2de42-e905-4072-852a-a03737ade5f7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:34.219690 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-d1d2de42-e905-4072-852a-a03737ade5f7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:34.228473 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-d1d2de42-e905-4072-852a-a03737ade5f7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:34.230149 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-d1d2de42-e905-4072-852a-a03737ade5f7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:34.231377 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-d1d2de42-e905-4072-852a-a03737ade5f7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1405 microversion: 2.20 time: 0.224757 Oct 28 19:10:34.232019 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 324/625] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:34 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:34.766163 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-fd60083f-8c4e-4749-8c34-54d8abd2e2e4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:34.767277 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-fd60083f-8c4e-4749-8c34-54d8abd2e2e4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:34.781954 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fd60083f-8c4e-4749-8c34-54d8abd2e2e4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:34.783014 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fd60083f-8c4e-4749-8c34-54d8abd2e2e4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:34.784530 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fd60083f-8c4e-4749-8c34-54d8abd2e2e4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:34.785294 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fd60083f-8c4e-4749-8c34-54d8abd2e2e4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:34.785760 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fd60083f-8c4e-4749-8c34-54d8abd2e2e4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:34.786198 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fd60083f-8c4e-4749-8c34-54d8abd2e2e4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:34.993255 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-fd60083f-8c4e-4749-8c34-54d8abd2e2e4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:35.014943 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-fd60083f-8c4e-4749-8c34-54d8abd2e2e4 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.254797 Oct 28 19:10:35.017701 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 302/626] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:34 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:35.269218 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-2008d1ac-9ec7-4b1a-833a-86867463a5a2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:35.271844 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-2008d1ac-9ec7-4b1a-833a-86867463a5a2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:35.287656 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2008d1ac-9ec7-4b1a-833a-86867463a5a2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:35.288256 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2008d1ac-9ec7-4b1a-833a-86867463a5a2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:35.290523 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2008d1ac-9ec7-4b1a-833a-86867463a5a2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:35.291442 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2008d1ac-9ec7-4b1a-833a-86867463a5a2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:35.292611 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2008d1ac-9ec7-4b1a-833a-86867463a5a2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:35.296065 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2008d1ac-9ec7-4b1a-833a-86867463a5a2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:35.559312 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-2008d1ac-9ec7-4b1a-833a-86867463a5a2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:35.570156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-2008d1ac-9ec7-4b1a-833a-86867463a5a2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:35.571953 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-2008d1ac-9ec7-4b1a-833a-86867463a5a2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:35.574003 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-2008d1ac-9ec7-4b1a-833a-86867463a5a2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1405 microversion: 2.20 time: 0.318638 Oct 28 19:10:35.575246 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 325/627] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:35 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1405 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:36.045427 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-9be6dbdd-ccf4-4e22-988e-35cd6c7a0240 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:36.046050 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-9be6dbdd-ccf4-4e22-988e-35cd6c7a0240 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:36.064693 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9be6dbdd-ccf4-4e22-988e-35cd6c7a0240 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:36.066855 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9be6dbdd-ccf4-4e22-988e-35cd6c7a0240 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:36.067997 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9be6dbdd-ccf4-4e22-988e-35cd6c7a0240 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:36.072239 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9be6dbdd-ccf4-4e22-988e-35cd6c7a0240 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:36.073682 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9be6dbdd-ccf4-4e22-988e-35cd6c7a0240 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:36.074919 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9be6dbdd-ccf4-4e22-988e-35cd6c7a0240 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:36.095749 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell0:SELECT=2 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:36.600600 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-8721cce9-2772-46db-95dc-c4374beb5d12 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:36.601855 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-8721cce9-2772-46db-95dc-c4374beb5d12 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:36.605201 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=2 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:36.606131 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=10 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:36.613494 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8721cce9-2772-46db-95dc-c4374beb5d12 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:36.614271 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8721cce9-2772-46db-95dc-c4374beb5d12 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:36.615148 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8721cce9-2772-46db-95dc-c4374beb5d12 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:36.616275 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8721cce9-2772-46db-95dc-c4374beb5d12 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:36.617383 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8721cce9-2772-46db-95dc-c4374beb5d12 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:36.618541 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-8721cce9-2772-46db-95dc-c4374beb5d12 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:36.630731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-9be6dbdd-ccf4-4e22-988e-35cd6c7a0240 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:36.647210 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-9be6dbdd-ccf4-4e22-988e-35cd6c7a0240 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.599405 Oct 28 19:10:36.648446 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 303/628] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:36 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:36.784581 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-8721cce9-2772-46db-95dc-c4374beb5d12 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:36.794630 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-8721cce9-2772-46db-95dc-c4374beb5d12 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:36.796116 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-8721cce9-2772-46db-95dc-c4374beb5d12 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:36.797777 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-8721cce9-2772-46db-95dc-c4374beb5d12 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1405 microversion: 2.20 time: 0.201607 Oct 28 19:10:36.798343 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 326/629] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:36 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:10:37.148561 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-d4dfaf80-ccf7-481f-a881-d6d1b9d563db req-e5d09085-5a95-463e-b330-34adac743284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c2187f-f4f1-4d25-96ff-2b032986f8b1", "name": "network-vif-plugged", "status": "completed", "tag": "b53160b4-c25e-42f7-a698-ec959ecf8b6d"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:37.162550 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-d4dfaf80-ccf7-481f-a881-d6d1b9d563db req-e5d09085-5a95-463e-b330-34adac743284 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:37.163336 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-d4dfaf80-ccf7-481f-a881-d6d1b9d563db req-e5d09085-5a95-463e-b330-34adac743284 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:37.164020 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-d4dfaf80-ccf7-481f-a881-d6d1b9d563db req-e5d09085-5a95-463e-b330-34adac743284 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:37.194287 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-d4dfaf80-ccf7-481f-a881-d6d1b9d563db req-e5d09085-5a95-463e-b330-34adac743284 service nova] Creating event network-vif-plugged:b53160b4-c25e-42f7-a698-ec959ecf8b6d for instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 on hv-cinder-86236 Oct 28 19:10:37.200493 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-d4dfaf80-ccf7-481f-a881-d6d1b9d563db req-e5d09085-5a95-463e-b330-34adac743284 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056124 Oct 28 19:10:37.201522 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 304/630] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:37.671544 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-95d42535-81d5-458b-b5b4-bd5776395bbd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:37.672142 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-95d42535-81d5-458b-b5b4-bd5776395bbd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:37.678554 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-95d42535-81d5-458b-b5b4-bd5776395bbd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:37.679766 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-95d42535-81d5-458b-b5b4-bd5776395bbd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:37.680473 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-95d42535-81d5-458b-b5b4-bd5776395bbd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:37.681412 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-95d42535-81d5-458b-b5b4-bd5776395bbd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:37.681868 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-95d42535-81d5-458b-b5b4-bd5776395bbd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:37.682296 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-95d42535-81d5-458b-b5b4-bd5776395bbd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:37.826065 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-36358178-41b2-4c95-9972-14a8a8811ba1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:37.827029 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-36358178-41b2-4c95-9972-14a8a8811ba1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:37.835773 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36358178-41b2-4c95-9972-14a8a8811ba1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:37.836443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36358178-41b2-4c95-9972-14a8a8811ba1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:37.837031 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36358178-41b2-4c95-9972-14a8a8811ba1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:37.837881 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36358178-41b2-4c95-9972-14a8a8811ba1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:37.838486 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36358178-41b2-4c95-9972-14a8a8811ba1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:37.839098 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36358178-41b2-4c95-9972-14a8a8811ba1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:37.870774 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-95d42535-81d5-458b-b5b4-bd5776395bbd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:37.879958 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-95d42535-81d5-458b-b5b4-bd5776395bbd tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.211966 Oct 28 19:10:37.880539 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 327/631] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:37 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:38.045566 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-36358178-41b2-4c95-9972-14a8a8811ba1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:38.054027 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-36358178-41b2-4c95-9972-14a8a8811ba1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:38.055522 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-36358178-41b2-4c95-9972-14a8a8811ba1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:38.057303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-36358178-41b2-4c95-9972-14a8a8811ba1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1405 microversion: 2.20 time: 0.239357 Oct 28 19:10:38.058067 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 305/632] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:37 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:38.904626 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-2ae0554a-eb73-452e-9a2b-d7bbb48ab092 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:38.906106 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-2ae0554a-eb73-452e-9a2b-d7bbb48ab092 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:38.912874 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2ae0554a-eb73-452e-9a2b-d7bbb48ab092 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:38.913307 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2ae0554a-eb73-452e-9a2b-d7bbb48ab092 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:38.913749 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2ae0554a-eb73-452e-9a2b-d7bbb48ab092 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:38.914478 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2ae0554a-eb73-452e-9a2b-d7bbb48ab092 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:38.914934 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2ae0554a-eb73-452e-9a2b-d7bbb48ab092 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:38.915582 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2ae0554a-eb73-452e-9a2b-d7bbb48ab092 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:39.057573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-2ae0554a-eb73-452e-9a2b-d7bbb48ab092 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:39.067456 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-2ae0554a-eb73-452e-9a2b-d7bbb48ab092 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.166843 Oct 28 19:10:39.068592 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 328/633] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:38 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:39.085865 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c882b7ac-114f-4895-8f94-b4931ead1cfc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:39.086674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-c882b7ac-114f-4895-8f94-b4931ead1cfc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:39.094602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c882b7ac-114f-4895-8f94-b4931ead1cfc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:39.095171 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c882b7ac-114f-4895-8f94-b4931ead1cfc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:39.095695 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c882b7ac-114f-4895-8f94-b4931ead1cfc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:39.096708 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c882b7ac-114f-4895-8f94-b4931ead1cfc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:39.097266 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c882b7ac-114f-4895-8f94-b4931ead1cfc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:39.097777 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c882b7ac-114f-4895-8f94-b4931ead1cfc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:39.568825 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c882b7ac-114f-4895-8f94-b4931ead1cfc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:39.583208 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c882b7ac-114f-4895-8f94-b4931ead1cfc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:39.585365 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c882b7ac-114f-4895-8f94-b4931ead1cfc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:39.589750 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-c882b7ac-114f-4895-8f94-b4931ead1cfc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1405 microversion: 2.20 time: 0.508100 Oct 28 19:10:39.590384 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 306/634] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:39 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1405 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:40.098101 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-865d0c92-07d1-4dd9-ae85-026a74f126fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:40.099435 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-865d0c92-07d1-4dd9-ae85-026a74f126fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:40.115609 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-865d0c92-07d1-4dd9-ae85-026a74f126fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:40.116298 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-865d0c92-07d1-4dd9-ae85-026a74f126fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:40.116892 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-865d0c92-07d1-4dd9-ae85-026a74f126fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:40.117760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-865d0c92-07d1-4dd9-ae85-026a74f126fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:40.118363 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-865d0c92-07d1-4dd9-ae85-026a74f126fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:40.119046 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-865d0c92-07d1-4dd9-ae85-026a74f126fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:40.127005 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=100 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:40.348697 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-865d0c92-07d1-4dd9-ae85-026a74f126fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:40.357920 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-865d0c92-07d1-4dd9-ae85-026a74f126fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.267198 Oct 28 19:10:40.363443 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 329/635] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:40 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:40.618392 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-2fb8e9a0-03c1-4bf5-81f1-f8948ffe34a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:40.619696 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-2fb8e9a0-03c1-4bf5-81f1-f8948ffe34a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:40.627197 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2fb8e9a0-03c1-4bf5-81f1-f8948ffe34a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:40.627946 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2fb8e9a0-03c1-4bf5-81f1-f8948ffe34a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:40.628573 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2fb8e9a0-03c1-4bf5-81f1-f8948ffe34a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:40.629738 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2fb8e9a0-03c1-4bf5-81f1-f8948ffe34a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:40.630540 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2fb8e9a0-03c1-4bf5-81f1-f8948ffe34a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:40.631317 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2fb8e9a0-03c1-4bf5-81f1-f8948ffe34a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:40.793896 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2fb8e9a0-03c1-4bf5-81f1-f8948ffe34a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:40.805800 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2fb8e9a0-03c1-4bf5-81f1-f8948ffe34a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:40.807778 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2fb8e9a0-03c1-4bf5-81f1-f8948ffe34a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:40.808978 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-2fb8e9a0-03c1-4bf5-81f1-f8948ffe34a4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1597 microversion: 2.20 time: 0.195128 Oct 28 19:10:40.824740 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 307/636] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:40 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1597 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:40.837202 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-869c728a-ed0e-4090-bb2c-84a7c4f10bc9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:40.837841 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-869c728a-ed0e-4090-bb2c-84a7c4f10bc9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:40.848510 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-869c728a-ed0e-4090-bb2c-84a7c4f10bc9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:40.848510 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-869c728a-ed0e-4090-bb2c-84a7c4f10bc9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:40.848510 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-869c728a-ed0e-4090-bb2c-84a7c4f10bc9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:40.848510 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-869c728a-ed0e-4090-bb2c-84a7c4f10bc9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:40.849134 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-869c728a-ed0e-4090-bb2c-84a7c4f10bc9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:40.849571 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-869c728a-ed0e-4090-bb2c-84a7c4f10bc9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:41.011706 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-869c728a-ed0e-4090-bb2c-84a7c4f10bc9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.178341 Oct 28 19:10:41.013251 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 330/637] 10.222.0.58 () {60 vars in 1316 bytes} [Fri Oct 28 19:10:40 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:10:41.389891 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b92acb66-7f25-4d5e-a72b-278157514700 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:41.390889 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b92acb66-7f25-4d5e-a72b-278157514700 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:41.404162 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b92acb66-7f25-4d5e-a72b-278157514700 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:41.405016 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b92acb66-7f25-4d5e-a72b-278157514700 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:41.406309 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b92acb66-7f25-4d5e-a72b-278157514700 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:41.407663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b92acb66-7f25-4d5e-a72b-278157514700 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:41.408325 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b92acb66-7f25-4d5e-a72b-278157514700 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:41.408904 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b92acb66-7f25-4d5e-a72b-278157514700 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:41.846034 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b92acb66-7f25-4d5e-a72b-278157514700 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:41.858149 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b92acb66-7f25-4d5e-a72b-278157514700 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.475578 Oct 28 19:10:41.863805 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 308/638] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:41 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:42.883572 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-985d7ffc-f10c-4c53-a8d7-6b967e237931 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:42.884020 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-985d7ffc-f10c-4c53-a8d7-6b967e237931 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:42.915104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-985d7ffc-f10c-4c53-a8d7-6b967e237931 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:42.915870 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-985d7ffc-f10c-4c53-a8d7-6b967e237931 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:42.918249 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-985d7ffc-f10c-4c53-a8d7-6b967e237931 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:42.922075 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-985d7ffc-f10c-4c53-a8d7-6b967e237931 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:42.923783 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-985d7ffc-f10c-4c53-a8d7-6b967e237931 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:42.924402 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-985d7ffc-f10c-4c53-a8d7-6b967e237931 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:42.965611 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-dca969a8-998a-49a8-8539-b8d663e68e9c req-652ac2e1-7b64-48c8-bf80-74954b207378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c2187f-f4f1-4d25-96ff-2b032986f8b1", "tag": "b53160b4-c25e-42f7-a698-ec959ecf8b6d"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:42.984510 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-dca969a8-998a-49a8-8539-b8d663e68e9c req-652ac2e1-7b64-48c8-bf80-74954b207378 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:42.985012 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-dca969a8-998a-49a8-8539-b8d663e68e9c req-652ac2e1-7b64-48c8-bf80-74954b207378 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:42.985455 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-dca969a8-998a-49a8-8539-b8d663e68e9c req-652ac2e1-7b64-48c8-bf80-74954b207378 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:43.019796 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-dca969a8-998a-49a8-8539-b8d663e68e9c req-652ac2e1-7b64-48c8-bf80-74954b207378 service nova] Creating event network-changed:b53160b4-c25e-42f7-a698-ec959ecf8b6d for instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 on hv-cinder-86236 Oct 28 19:10:43.025600 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-dca969a8-998a-49a8-8539-b8d663e68e9c req-652ac2e1-7b64-48c8-bf80-74954b207378 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064720 Oct 28 19:10:43.027467 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 309/639] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:10:43.213086 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-985d7ffc-f10c-4c53-a8d7-6b967e237931 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:43.228977 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-985d7ffc-f10c-4c53-a8d7-6b967e237931 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.349211 Oct 28 19:10:43.229932 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 331/640] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:42 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:44.254761 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-8ece2f1b-1417-4b13-8bc1-159c06f8a5ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:44.256282 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-8ece2f1b-1417-4b13-8bc1-159c06f8a5ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:44.271533 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8ece2f1b-1417-4b13-8bc1-159c06f8a5ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:44.272045 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8ece2f1b-1417-4b13-8bc1-159c06f8a5ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:44.272600 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8ece2f1b-1417-4b13-8bc1-159c06f8a5ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:44.273776 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8ece2f1b-1417-4b13-8bc1-159c06f8a5ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:44.274351 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8ece2f1b-1417-4b13-8bc1-159c06f8a5ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:44.276090 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8ece2f1b-1417-4b13-8bc1-159c06f8a5ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:44.507628 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-8ece2f1b-1417-4b13-8bc1-159c06f8a5ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:44.525081 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-8ece2f1b-1417-4b13-8bc1-159c06f8a5ec tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.272975 Oct 28 19:10:44.534214 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 310/641] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:44 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:45.549377 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-29bea422-caa2-4b1f-b4fc-33d650ff0613 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:45.550054 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-29bea422-caa2-4b1f-b4fc-33d650ff0613 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:45.552909 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:45.557252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-29bea422-caa2-4b1f-b4fc-33d650ff0613 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:45.557937 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-29bea422-caa2-4b1f-b4fc-33d650ff0613 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:45.558545 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-29bea422-caa2-4b1f-b4fc-33d650ff0613 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:45.559461 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-29bea422-caa2-4b1f-b4fc-33d650ff0613 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:45.560028 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-29bea422-caa2-4b1f-b4fc-33d650ff0613 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:45.560348 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-29bea422-caa2-4b1f-b4fc-33d650ff0613 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:45.781575 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-29bea422-caa2-4b1f-b4fc-33d650ff0613 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:45.791579 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-29bea422-caa2-4b1f-b4fc-33d650ff0613 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.246342 Oct 28 19:10:45.810752 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 332/642] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:45 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:46.816413 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-58e87c50-c7dd-4cee-93c2-38111ec51c5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:46.817182 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-58e87c50-c7dd-4cee-93c2-38111ec51c5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:46.823652 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-58e87c50-c7dd-4cee-93c2-38111ec51c5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:46.824364 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-58e87c50-c7dd-4cee-93c2-38111ec51c5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:46.824974 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-58e87c50-c7dd-4cee-93c2-38111ec51c5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:46.825951 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-58e87c50-c7dd-4cee-93c2-38111ec51c5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:46.826557 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-58e87c50-c7dd-4cee-93c2-38111ec51c5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:46.827893 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-58e87c50-c7dd-4cee-93c2-38111ec51c5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:46.998410 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-58e87c50-c7dd-4cee-93c2-38111ec51c5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:47.011671 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-58e87c50-c7dd-4cee-93c2-38111ec51c5a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.199106 Oct 28 19:10:47.013088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 311/643] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:46 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:48.040395 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-5eb947b3-5493-4c47-8020-e49f23973ab9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:48.042352 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-5eb947b3-5493-4c47-8020-e49f23973ab9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:48.051546 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5eb947b3-5493-4c47-8020-e49f23973ab9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:48.053693 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5eb947b3-5493-4c47-8020-e49f23973ab9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:48.054822 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5eb947b3-5493-4c47-8020-e49f23973ab9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:48.056130 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5eb947b3-5493-4c47-8020-e49f23973ab9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:48.058529 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5eb947b3-5493-4c47-8020-e49f23973ab9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:48.059214 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5eb947b3-5493-4c47-8020-e49f23973ab9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:48.245416 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-5eb947b3-5493-4c47-8020-e49f23973ab9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:48.258126 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-5eb947b3-5493-4c47-8020-e49f23973ab9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.223784 Oct 28 19:10:48.259671 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 333/644] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:48 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:49.282516 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-3233db95-8efd-4927-bb97-d06105b05a5f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:49.283236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-3233db95-8efd-4927-bb97-d06105b05a5f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:49.289894 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3233db95-8efd-4927-bb97-d06105b05a5f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:49.290604 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3233db95-8efd-4927-bb97-d06105b05a5f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:49.291066 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3233db95-8efd-4927-bb97-d06105b05a5f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:49.291926 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3233db95-8efd-4927-bb97-d06105b05a5f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:49.292525 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3233db95-8efd-4927-bb97-d06105b05a5f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:49.293268 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3233db95-8efd-4927-bb97-d06105b05a5f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:49.444921 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3233db95-8efd-4927-bb97-d06105b05a5f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:49.462133 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-3233db95-8efd-4927-bb97-d06105b05a5f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.184113 Oct 28 19:10:49.479011 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 312/645] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:49 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:50.040730 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-237c4d54-0d84-4c96-bb62-be71c6b7365d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Action: 'create', calling method: .version_select at 0x7f9bf6892ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-502624824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHInaJ4Mi1ifIoEFo22OMb7kKJf48TqqzEOX7KnsAJLruohOv7+/fezJG/bl7rnOrBm9H+ldLentUmnjL5rSpaf1sebM9grmssNltI1bo9jCUv7wbEZ7jqKus+T7YqsmFg=="}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:50.056631 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-237c4d54-0d84-4c96-bb62-be71c6b7365d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Getting quotas for project 10e5356491f54ddeb10f71d5c927e753. Resources: {'key_pairs'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:10:50.060510 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-237c4d54-0d84-4c96-bb62-be71c6b7365d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Getting quotas for user 9a4a47b7a9284cc8b44c8c732e5b6647 and project 10e5356491f54ddeb10f71d5c927e753. Resources: {'key_pairs'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:10:50.084860 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-237c4d54-0d84-4c96-bb62-be71c6b7365d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.208235 Oct 28 19:10:50.085473 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 334/646] 10.222.0.58 () {60 vars in 1159 bytes} [Fri Oct 28 19:10:49 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:50.487939 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-0b939838-e8eb-4099-ad6f-57feeaf8fd6b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:50.488566 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-0b939838-e8eb-4099-ad6f-57feeaf8fd6b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:50.494933 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0b939838-e8eb-4099-ad6f-57feeaf8fd6b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:50.495542 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0b939838-e8eb-4099-ad6f-57feeaf8fd6b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:50.496028 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0b939838-e8eb-4099-ad6f-57feeaf8fd6b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:50.496777 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0b939838-e8eb-4099-ad6f-57feeaf8fd6b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:50.497402 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0b939838-e8eb-4099-ad6f-57feeaf8fd6b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:50.497841 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0b939838-e8eb-4099-ad6f-57feeaf8fd6b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:50.682344 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-0b939838-e8eb-4099-ad6f-57feeaf8fd6b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:50.686875 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=100 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:50.693012 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-0b939838-e8eb-4099-ad6f-57feeaf8fd6b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1737 microversion: 2.1 time: 0.209232 Oct 28 19:10:50.693585 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 313/647] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:50 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:51.717109 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-ed06b8b2-4eb4-4cbd-930b-e7dce63077f0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:51.718290 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-ed06b8b2-4eb4-4cbd-930b-e7dce63077f0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:51.725250 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ed06b8b2-4eb4-4cbd-930b-e7dce63077f0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:51.725736 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ed06b8b2-4eb4-4cbd-930b-e7dce63077f0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:51.726170 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ed06b8b2-4eb4-4cbd-930b-e7dce63077f0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:51.732370 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ed06b8b2-4eb4-4cbd-930b-e7dce63077f0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:51.733158 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ed06b8b2-4eb4-4cbd-930b-e7dce63077f0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:51.733836 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ed06b8b2-4eb4-4cbd-930b-e7dce63077f0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:51.899412 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ed06b8b2-4eb4-4cbd-930b-e7dce63077f0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:51.908711 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-ed06b8b2-4eb4-4cbd-930b-e7dce63077f0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1717 microversion: 2.1 time: 0.195248 Oct 28 19:10:51.909163 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 335/648] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:51 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1717 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:52.029361 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c8b83427-d37b-4cb4-b2ef-7978f6afd37d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:52.029923 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-c8b83427-d37b-4cb4-b2ef-7978f6afd37d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:52.037314 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c8b83427-d37b-4cb4-b2ef-7978f6afd37d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:52.038087 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c8b83427-d37b-4cb4-b2ef-7978f6afd37d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:52.038734 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c8b83427-d37b-4cb4-b2ef-7978f6afd37d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:52.039524 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c8b83427-d37b-4cb4-b2ef-7978f6afd37d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:52.040155 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c8b83427-d37b-4cb4-b2ef-7978f6afd37d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:52.040587 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c8b83427-d37b-4cb4-b2ef-7978f6afd37d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:52.136454 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.wsgi [None req-c8b83427-d37b-4cb4-b2ef-7978f6afd37d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] HTTP exception thrown: Cannot 'detach_volume' instance 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f while it is in vm_state rescued Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c8b83427-d37b-4cb4-b2ef-7978f6afd37d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Request method failure captured: Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: request: DELETE /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/os-volume_attachments/5856a454-f918-4084-8635-e661ad162b63 HTTP/1.1 Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept: application/json Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept-Encoding: identity Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Connection: close Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Length: 0 Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Type: application/json Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Host: 10.222.0.58 Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Openstack-System-Scope: None Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Auth-Token: gAAAAABjXCglU6keeyc9TPFu8kh2CtSTL27mYzieTeXTMg3qjeLwWS58Om5L1-wzv5iwcJqqpWrZlbacG63VxxUqEcwRqSRGut_CvjvYM0Iq9ARpxZRlx9JGTssQ2QQL0BA1xD17zsswm8pySHHhA5LPoDCKLfH2eOnw8zYt795C9xWjuK8UoFU Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Id: None Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Name: None Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Identity-Status: Confirmed Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Is-Admin-Project: True Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Id: default Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Name: Default Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Id: 4f6c133d9594455182ac1b9ce13df65c Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-136875089 Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Role: member,reader Oct 28 19:10:52.138405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Roles: member,reader Oct 28 19:10:52.140620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:10:52.140620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant: tempest-ServerRescueNegativeTestJSON-136875089 Oct 28 19:10:52.140620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Id: 4f6c133d9594455182ac1b9ce13df65c Oct 28 19:10:52.140620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-136875089 Oct 28 19:10:52.140620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User: tempest-ServerRescueNegativeTestJSON-136875089-project Oct 28 19:10:52.140620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Id: default Oct 28 19:10:52.140620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Name: Default Oct 28 19:10:52.140620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Id: c8ca34fc5c5743d0b5e3f4f97ae285e0 Oct 28 19:10:52.140620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Name: tempest-ServerRescueNegativeTestJSON-136875089-project Oct 28 19:10:52.140620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: method: > Oct 28 19:10:52.140620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: exception: Cannot 'detach_volume' instance 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f while it is in vm_state rescued Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: action_args: {'server_id': '9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f', 'id': '5856a454-f918-4084-8635-e661ad162b63'} Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:52.141303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:52.142674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 28 19:10:52.142674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 19:10:52.142674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 19:10:52.142674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 19:10:52.142674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f while it is in vm_state rescued Oct 28 19:10:52.142674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:10:52.142674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:52.142674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:10:52.142674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:52.142674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:52.142674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:52.142674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:52.142674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:52.142674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f while it is in vm_state rescued Oct 28 19:10:52.142674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:10:52.142674 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c8b83427-d37b-4cb4-b2ef-7978f6afd37d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Returning 409 to user: Cannot 'detach_volume' instance 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f while it is in vm_state rescued {{(pid=118875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:52.143746 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-c8b83427-d37b-4cb4-b2ef-7978f6afd37d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/os-volume_attachments/5856a454-f918-4084-8635-e661ad162b63" status: 409 len: 152 microversion: 2.1 time: 0.115375 Oct 28 19:10:52.143746 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 314/649] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Oct 28 19:10:52 2022] DELETE /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/os-volume_attachments/5856a454-f918-4084-8635-e661ad162b63 => generated 152 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:10:52.150163 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1cb59012-a1f3-4284-9436-2e8f2e208d37 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:52.150813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-1cb59012-a1f3-4284-9436-2e8f2e208d37 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:52.157387 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cb59012-a1f3-4284-9436-2e8f2e208d37 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:52.157937 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cb59012-a1f3-4284-9436-2e8f2e208d37 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:52.158433 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cb59012-a1f3-4284-9436-2e8f2e208d37 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:52.159329 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cb59012-a1f3-4284-9436-2e8f2e208d37 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:52.159776 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cb59012-a1f3-4284-9436-2e8f2e208d37 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:52.160297 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cb59012-a1f3-4284-9436-2e8f2e208d37 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:52.235608 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-1cb59012-a1f3-4284-9436-2e8f2e208d37 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "POST /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/action" status: 202 len: 0 microversion: 2.1 time: 0.089022 Oct 28 19:10:52.237119 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 336/650] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Oct 28 19:10:52 2022] POST /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:52.258440 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-e33b883a-0ea1-4e87-9c15-97b7068c73a8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:52.259499 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-e33b883a-0ea1-4e87-9c15-97b7068c73a8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:52.271136 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e33b883a-0ea1-4e87-9c15-97b7068c73a8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:52.271932 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e33b883a-0ea1-4e87-9c15-97b7068c73a8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:52.272643 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e33b883a-0ea1-4e87-9c15-97b7068c73a8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:52.273556 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e33b883a-0ea1-4e87-9c15-97b7068c73a8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:52.274191 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e33b883a-0ea1-4e87-9c15-97b7068c73a8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:52.274782 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e33b883a-0ea1-4e87-9c15-97b7068c73a8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:52.416721 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-e33b883a-0ea1-4e87-9c15-97b7068c73a8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:52.425737 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-e33b883a-0ea1-4e87-9c15-97b7068c73a8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1725 microversion: 2.1 time: 0.183251 Oct 28 19:10:52.426314 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 315/651] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:52 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:53.450365 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4370d766-abb9-4c2c-b6ef-6f657f0a1664 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:53.451092 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-4370d766-abb9-4c2c-b6ef-6f657f0a1664 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:53.457885 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4370d766-abb9-4c2c-b6ef-6f657f0a1664 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:53.458383 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4370d766-abb9-4c2c-b6ef-6f657f0a1664 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:53.458832 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4370d766-abb9-4c2c-b6ef-6f657f0a1664 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:53.459580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4370d766-abb9-4c2c-b6ef-6f657f0a1664 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:53.460037 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4370d766-abb9-4c2c-b6ef-6f657f0a1664 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:53.460467 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4370d766-abb9-4c2c-b6ef-6f657f0a1664 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:53.595040 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4370d766-abb9-4c2c-b6ef-6f657f0a1664 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:53.603322 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-4370d766-abb9-4c2c-b6ef-6f657f0a1664 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1725 microversion: 2.1 time: 0.157230 Oct 28 19:10:53.603879 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 337/652] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:53 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:54.628380 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-7d4bdf80-1344-4637-92ba-22084f865835 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:54.629173 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-7d4bdf80-1344-4637-92ba-22084f865835 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:54.637289 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7d4bdf80-1344-4637-92ba-22084f865835 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:54.637812 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7d4bdf80-1344-4637-92ba-22084f865835 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:54.638252 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7d4bdf80-1344-4637-92ba-22084f865835 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:54.638947 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7d4bdf80-1344-4637-92ba-22084f865835 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:54.639419 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7d4bdf80-1344-4637-92ba-22084f865835 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:54.639891 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7d4bdf80-1344-4637-92ba-22084f865835 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:54.770887 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-7d4bdf80-1344-4637-92ba-22084f865835 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:54.779397 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-7d4bdf80-1344-4637-92ba-22084f865835 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1725 microversion: 2.1 time: 0.156073 Oct 28 19:10:54.780657 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 316/653] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:54 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:55.803483 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-3d32e4ce-3bfe-4fa0-9e6f-101146b0fa83 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:55.804093 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-3d32e4ce-3bfe-4fa0-9e6f-101146b0fa83 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:55.810219 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3d32e4ce-3bfe-4fa0-9e6f-101146b0fa83 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:55.810790 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3d32e4ce-3bfe-4fa0-9e6f-101146b0fa83 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:55.811298 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3d32e4ce-3bfe-4fa0-9e6f-101146b0fa83 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:55.812499 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3d32e4ce-3bfe-4fa0-9e6f-101146b0fa83 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:55.812948 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3d32e4ce-3bfe-4fa0-9e6f-101146b0fa83 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:55.813370 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3d32e4ce-3bfe-4fa0-9e6f-101146b0fa83 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:55.956946 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3d32e4ce-3bfe-4fa0-9e6f-101146b0fa83 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:55.965318 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-3d32e4ce-3bfe-4fa0-9e6f-101146b0fa83 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1731 microversion: 2.1 time: 0.165765 Oct 28 19:10:55.965891 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 338/654] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:55 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:55.988514 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-391b8fd7-07a6-4d89-80a2-feb7a275b81a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:55.989016 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-391b8fd7-07a6-4d89-80a2-feb7a275b81a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:55.991478 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:55.996711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-391b8fd7-07a6-4d89-80a2-feb7a275b81a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:55.997237 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-391b8fd7-07a6-4d89-80a2-feb7a275b81a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:55.997686 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-391b8fd7-07a6-4d89-80a2-feb7a275b81a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:55.998391 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-391b8fd7-07a6-4d89-80a2-feb7a275b81a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:55.998852 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-391b8fd7-07a6-4d89-80a2-feb7a275b81a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:55.999942 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-391b8fd7-07a6-4d89-80a2-feb7a275b81a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:56.179515 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-391b8fd7-07a6-4d89-80a2-feb7a275b81a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.195400 Oct 28 19:10:56.180366 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 317/655] 10.222.0.58 () {58 vars in 1275 bytes} [Fri Oct 28 19:10:55 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/os-interface => generated 284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:57.076828 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-8c8b75e3-539c-404b-8a06-0eb58a4bc531 req-6e27b200-57f3-463d-bfd6-94003b237d7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f", "tag": "92395a5b-edfc-4644-8dc9-9103854d9dac"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:57.086925 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-8c8b75e3-539c-404b-8a06-0eb58a4bc531 req-6e27b200-57f3-463d-bfd6-94003b237d7e service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:57.087428 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-8c8b75e3-539c-404b-8a06-0eb58a4bc531 req-6e27b200-57f3-463d-bfd6-94003b237d7e service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:57.087861 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-8c8b75e3-539c-404b-8a06-0eb58a4bc531 req-6e27b200-57f3-463d-bfd6-94003b237d7e service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:57.101284 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-8c8b75e3-539c-404b-8a06-0eb58a4bc531 req-6e27b200-57f3-463d-bfd6-94003b237d7e service nova] Creating event network-changed:92395a5b-edfc-4644-8dc9-9103854d9dac for instance 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f on hv-cinder-86236 Oct 28 19:10:57.106572 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-8c8b75e3-539c-404b-8a06-0eb58a4bc531 req-6e27b200-57f3-463d-bfd6-94003b237d7e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036937 Oct 28 19:10:57.107408 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 339/656] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:10:59.122555 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-03742239-6f8e-473b-9b46-bbaa1219233f req-ed4e6130-2f8f-4ae6-bda0-a28514f2f2ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f", "tag": "92395a5b-edfc-4644-8dc9-9103854d9dac"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:59.131753 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-03742239-6f8e-473b-9b46-bbaa1219233f req-ed4e6130-2f8f-4ae6-bda0-a28514f2f2ba service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:59.132222 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-03742239-6f8e-473b-9b46-bbaa1219233f req-ed4e6130-2f8f-4ae6-bda0-a28514f2f2ba service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:59.132649 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-03742239-6f8e-473b-9b46-bbaa1219233f req-ed4e6130-2f8f-4ae6-bda0-a28514f2f2ba service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:59.145601 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-03742239-6f8e-473b-9b46-bbaa1219233f req-ed4e6130-2f8f-4ae6-bda0-a28514f2f2ba service nova] Creating event network-changed:92395a5b-edfc-4644-8dc9-9103854d9dac for instance 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f on hv-cinder-86236 Oct 28 19:10:59.150758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-03742239-6f8e-473b-9b46-bbaa1219233f req-ed4e6130-2f8f-4ae6-bda0-a28514f2f2ba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032537 Oct 28 19:10:59.151391 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 318/657] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:07.476302 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=4 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:07.477377 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:07.478003 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:07.482446 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-fbaf9c33-6715-4f0a-a63d-f739c82ed05c tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-681561140", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-502624824", "security_groups": [{"name": "tempest-secgroup-smoke-1418718547"}], "networks": [{"uuid": "203f53af-ce96-4bd7-b6af-5ae3751f97b7"}], "block_device_mapping_v2": [{"uuid": "56583da2-0f3e-474c-9892-e1b60ae59e6d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:07.691540 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.network.neutron [None req-fbaf9c33-6715-4f0a-a63d-f739c82ed05c tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] validate_networks() for [('203f53af-ce96-4bd7-b6af-5ae3751f97b7', None, None, None, None, None)] {{(pid=118874) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:11:08.050594 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-fbaf9c33-6715-4f0a-a63d-f739c82ed05c tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Flavor limits 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:11:08.051029 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-fbaf9c33-6715-4f0a-a63d-f739c82ed05c tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Image limits 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:11:08.051497 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-fbaf9c33-6715-4f0a-a63d-f739c82ed05c tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Flavor pref 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:11:08.051901 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-fbaf9c33-6715-4f0a-a63d-f739c82ed05c tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Image pref 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:11:08.052307 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-fbaf9c33-6715-4f0a-a63d-f739c82ed05c tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:11:08.061037 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fbaf9c33-6715-4f0a-a63d-f739c82ed05c tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:08.061508 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fbaf9c33-6715-4f0a-a63d-f739c82ed05c tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:08.061936 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fbaf9c33-6715-4f0a-a63d-f739c82ed05c tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:08.062650 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fbaf9c33-6715-4f0a-a63d-f739c82ed05c tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:08.063128 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fbaf9c33-6715-4f0a-a63d-f739c82ed05c tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:08.064178 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fbaf9c33-6715-4f0a-a63d-f739c82ed05c tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:08.080439 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-fbaf9c33-6715-4f0a-a63d-f739c82ed05c tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Getting quotas for project 10e5356491f54ddeb10f71d5c927e753. Resources: {'ram', 'instances', 'cores'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:08.084340 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-fbaf9c33-6715-4f0a-a63d-f739c82ed05c tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Getting quotas for user 9a4a47b7a9284cc8b44c8c732e5b6647 and project 10e5356491f54ddeb10f71d5c927e753. Resources: {'ram', 'instances', 'cores'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:08.141585 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-fbaf9c33-6715-4f0a-a63d-f739c82ed05c tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Going to run 1 instances... {{(pid=118874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:11:08.143826 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-fbaf9c33-6715-4f0a-a63d-f739c82ed05c tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='56583da2-0f3e-474c-9892-e1b60ae59e6d',volume_size=None,volume_type=None)] {{(pid=118874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:11:08.269760 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-fbaf9c33-6715-4f0a-a63d-f739c82ed05c tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.794374 Oct 28 19:11:08.270404 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 340/658] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Oct 28 19:11:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:11:08.282705 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d36fbbff-6ca7-4ec8-9c22-3301ff615f1e tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:08.283433 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d36fbbff-6ca7-4ec8-9c22-3301ff615f1e tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:08.341074 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d36fbbff-6ca7-4ec8-9c22-3301ff615f1e tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:08.349430 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d36fbbff-6ca7-4ec8-9c22-3301ff615f1e tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1087 microversion: 2.1 time: 0.071471 Oct 28 19:11:08.350003 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 319/659] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:08 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1087 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:09.372826 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-74e6fb5d-095b-4356-a0e4-64c59150ee65 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:09.373429 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-74e6fb5d-095b-4356-a0e4-64c59150ee65 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:09.380814 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-74e6fb5d-095b-4356-a0e4-64c59150ee65 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:09.381322 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-74e6fb5d-095b-4356-a0e4-64c59150ee65 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:09.381754 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-74e6fb5d-095b-4356-a0e4-64c59150ee65 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:09.382426 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-74e6fb5d-095b-4356-a0e4-64c59150ee65 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:09.382868 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-74e6fb5d-095b-4356-a0e4-64c59150ee65 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:09.383374 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-74e6fb5d-095b-4356-a0e4-64c59150ee65 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:09.443736 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-74e6fb5d-095b-4356-a0e4-64c59150ee65 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:09.452343 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-74e6fb5d-095b-4356-a0e4-64c59150ee65 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1185 microversion: 2.1 time: 0.083435 Oct 28 19:11:09.453042 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 341/660] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:09 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:10.408004 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-a60206f6-9d5f-49d9-8081-3dae302d72a8 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:10.410221 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-a60206f6-9d5f-49d9-8081-3dae302d72a8 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:10.413167 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:11:10.413324 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Fri Oct 28 19:11:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/os-volume_attachments (ip 10.222.0.58) !!! Oct 28 19:11:10.414423 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=24 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:10.422657 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a60206f6-9d5f-49d9-8081-3dae302d72a8 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:10.423232 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a60206f6-9d5f-49d9-8081-3dae302d72a8 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:10.423711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a60206f6-9d5f-49d9-8081-3dae302d72a8 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:10.424370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a60206f6-9d5f-49d9-8081-3dae302d72a8 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:10.424853 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a60206f6-9d5f-49d9-8081-3dae302d72a8 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:10.425260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a60206f6-9d5f-49d9-8081-3dae302d72a8 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:10.462893 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-a60206f6-9d5f-49d9-8081-3dae302d72a8 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059685 Oct 28 19:11:10.463869 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 320/661] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Oct 28 19:11:10 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:11:10.474848 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-226e25c1-5a50-4d5e-a991-97a39ec861df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:10.475781 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-226e25c1-5a50-4d5e-a991-97a39ec861df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:10.482282 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-226e25c1-5a50-4d5e-a991-97a39ec861df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:10.486101 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-226e25c1-5a50-4d5e-a991-97a39ec861df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:10.486694 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-226e25c1-5a50-4d5e-a991-97a39ec861df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:10.487933 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-226e25c1-5a50-4d5e-a991-97a39ec861df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:10.489293 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-226e25c1-5a50-4d5e-a991-97a39ec861df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:10.489937 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-226e25c1-5a50-4d5e-a991-97a39ec861df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:10.535920 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-7af44e51-4128-49bd-80f8-6ecb5c7d7e92 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:10.536723 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-7af44e51-4128-49bd-80f8-6ecb5c7d7e92 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:10.549824 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7af44e51-4128-49bd-80f8-6ecb5c7d7e92 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:10.559224 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7af44e51-4128-49bd-80f8-6ecb5c7d7e92 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:10.559696 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7af44e51-4128-49bd-80f8-6ecb5c7d7e92 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:10.560454 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7af44e51-4128-49bd-80f8-6ecb5c7d7e92 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:10.560930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7af44e51-4128-49bd-80f8-6ecb5c7d7e92 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:10.561370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7af44e51-4128-49bd-80f8-6ecb5c7d7e92 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:10.604661 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-7af44e51-4128-49bd-80f8-6ecb5c7d7e92 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Going to try to terminate instance {{(pid=118875) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:11:10.651302 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-226e25c1-5a50-4d5e-a991-97a39ec861df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:10.659499 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-226e25c1-5a50-4d5e-a991-97a39ec861df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1271 microversion: 2.1 time: 0.188663 Oct 28 19:11:10.660071 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 342/662] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:10 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:10.694132 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-7af44e51-4128-49bd-80f8-6ecb5c7d7e92 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "DELETE /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 204 len: 0 microversion: 2.1 time: 0.162016 Oct 28 19:11:10.694950 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 321/663] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Oct 28 19:11:10 2022] DELETE /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:11:10.704633 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-66fb8cbb-63d0-49d6-b873-2fc6abdfbbe3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:10.705968 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-66fb8cbb-63d0-49d6-b873-2fc6abdfbbe3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:10.712335 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-66fb8cbb-63d0-49d6-b873-2fc6abdfbbe3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:10.712827 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-66fb8cbb-63d0-49d6-b873-2fc6abdfbbe3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:10.713260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-66fb8cbb-63d0-49d6-b873-2fc6abdfbbe3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:10.713989 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-66fb8cbb-63d0-49d6-b873-2fc6abdfbbe3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:10.714437 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-66fb8cbb-63d0-49d6-b873-2fc6abdfbbe3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:10.714860 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-66fb8cbb-63d0-49d6-b873-2fc6abdfbbe3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:10.858194 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-66fb8cbb-63d0-49d6-b873-2fc6abdfbbe3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:10.866509 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-66fb8cbb-63d0-49d6-b873-2fc6abdfbbe3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1674 microversion: 2.1 time: 0.166839 Oct 28 19:11:10.867097 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 343/664] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:10 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:11.018463 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-4fde2377-97e2-4c31-b4d4-d61bd253576d req-2fa945aa-a4ae-4794-8150-74fd4b38c11b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "429f9d21-c184-4baa-b7ea-bd94656890f3", "tag": "47bb3174-db66-4aef-9eaa-fa1018a14bec"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:11.028181 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-4fde2377-97e2-4c31-b4d4-d61bd253576d req-2fa945aa-a4ae-4794-8150-74fd4b38c11b service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:11.028663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-4fde2377-97e2-4c31-b4d4-d61bd253576d req-2fa945aa-a4ae-4794-8150-74fd4b38c11b service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:11.029503 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-4fde2377-97e2-4c31-b4d4-d61bd253576d req-2fa945aa-a4ae-4794-8150-74fd4b38c11b service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:11.039870 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-4fde2377-97e2-4c31-b4d4-d61bd253576d req-2fa945aa-a4ae-4794-8150-74fd4b38c11b service nova] Creating event network-changed:47bb3174-db66-4aef-9eaa-fa1018a14bec for instance 429f9d21-c184-4baa-b7ea-bd94656890f3 on hv-cinder-86236 Oct 28 19:11:11.044616 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-4fde2377-97e2-4c31-b4d4-d61bd253576d req-2fa945aa-a4ae-4794-8150-74fd4b38c11b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030301 Oct 28 19:11:11.045208 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 322/665] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:11:11.682876 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-08dceef2-9de0-4abb-9c84-6a1447e88f05 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:11.683540 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-08dceef2-9de0-4abb-9c84-6a1447e88f05 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:11.690053 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-08dceef2-9de0-4abb-9c84-6a1447e88f05 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:11.690529 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-08dceef2-9de0-4abb-9c84-6a1447e88f05 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:11.690962 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-08dceef2-9de0-4abb-9c84-6a1447e88f05 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:11.691661 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-08dceef2-9de0-4abb-9c84-6a1447e88f05 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:11.692107 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-08dceef2-9de0-4abb-9c84-6a1447e88f05 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:11.692529 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-08dceef2-9de0-4abb-9c84-6a1447e88f05 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:11.819466 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-08dceef2-9de0-4abb-9c84-6a1447e88f05 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:11.827118 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-08dceef2-9de0-4abb-9c84-6a1447e88f05 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1259 microversion: 2.1 time: 0.148028 Oct 28 19:11:11.827682 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 344/666] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:11 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:11.891606 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d2a09f65-c32a-4429-bcb4-77cfa2b95d40 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:11.892329 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d2a09f65-c32a-4429-bcb4-77cfa2b95d40 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:11.898398 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d2a09f65-c32a-4429-bcb4-77cfa2b95d40 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:11.898876 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d2a09f65-c32a-4429-bcb4-77cfa2b95d40 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:11.899341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d2a09f65-c32a-4429-bcb4-77cfa2b95d40 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:11.900097 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d2a09f65-c32a-4429-bcb4-77cfa2b95d40 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:11.900552 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d2a09f65-c32a-4429-bcb4-77cfa2b95d40 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:11.900984 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d2a09f65-c32a-4429-bcb4-77cfa2b95d40 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:12.026918 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d2a09f65-c32a-4429-bcb4-77cfa2b95d40 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:12.035167 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d2a09f65-c32a-4429-bcb4-77cfa2b95d40 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1674 microversion: 2.1 time: 0.148168 Oct 28 19:11:12.035737 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 323/667] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:11 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:12.852032 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-247a5b1c-74ea-4ca3-9b8f-eb09c8c101bb tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:12.852740 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-247a5b1c-74ea-4ca3-9b8f-eb09c8c101bb tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:12.858873 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-247a5b1c-74ea-4ca3-9b8f-eb09c8c101bb tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:12.859380 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-247a5b1c-74ea-4ca3-9b8f-eb09c8c101bb tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:12.859806 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-247a5b1c-74ea-4ca3-9b8f-eb09c8c101bb tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:12.860485 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-247a5b1c-74ea-4ca3-9b8f-eb09c8c101bb tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:12.860985 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-247a5b1c-74ea-4ca3-9b8f-eb09c8c101bb tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:12.861404 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-247a5b1c-74ea-4ca3-9b8f-eb09c8c101bb tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:12.995111 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-247a5b1c-74ea-4ca3-9b8f-eb09c8c101bb tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:13.003278 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-247a5b1c-74ea-4ca3-9b8f-eb09c8c101bb tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1259 microversion: 2.1 time: 0.155178 Oct 28 19:11:13.003840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 345/668] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:12 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:13.059885 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-36c4e4c0-d109-4078-9655-f64e5c846017 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:13.060498 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-36c4e4c0-d109-4078-9655-f64e5c846017 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:13.067483 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36c4e4c0-d109-4078-9655-f64e5c846017 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:13.067965 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36c4e4c0-d109-4078-9655-f64e5c846017 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:13.068402 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36c4e4c0-d109-4078-9655-f64e5c846017 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:13.069098 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36c4e4c0-d109-4078-9655-f64e5c846017 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:13.069549 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36c4e4c0-d109-4078-9655-f64e5c846017 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:13.069973 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36c4e4c0-d109-4078-9655-f64e5c846017 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:13.198003 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-36c4e4c0-d109-4078-9655-f64e5c846017 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:13.205795 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-36c4e4c0-d109-4078-9655-f64e5c846017 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1674 microversion: 2.1 time: 0.149785 Oct 28 19:11:13.206381 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 324/669] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:13 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:14.027435 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-6c572c5c-3fae-44b4-b3f6-e2bd78edbbe8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:14.028043 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-6c572c5c-3fae-44b4-b3f6-e2bd78edbbe8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:14.034259 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6c572c5c-3fae-44b4-b3f6-e2bd78edbbe8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:14.034737 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6c572c5c-3fae-44b4-b3f6-e2bd78edbbe8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:14.035229 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6c572c5c-3fae-44b4-b3f6-e2bd78edbbe8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:14.036035 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6c572c5c-3fae-44b4-b3f6-e2bd78edbbe8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:14.036511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6c572c5c-3fae-44b4-b3f6-e2bd78edbbe8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:14.036930 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6c572c5c-3fae-44b4-b3f6-e2bd78edbbe8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:14.379398 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-2ff985f4-dcbf-4eb8-9339-9bf5aca17abc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:14.380430 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-2ff985f4-dcbf-4eb8-9339-9bf5aca17abc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:14.398253 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2ff985f4-dcbf-4eb8-9339-9bf5aca17abc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:14.399052 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2ff985f4-dcbf-4eb8-9339-9bf5aca17abc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:14.399753 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2ff985f4-dcbf-4eb8-9339-9bf5aca17abc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:14.400673 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2ff985f4-dcbf-4eb8-9339-9bf5aca17abc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:14.401341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2ff985f4-dcbf-4eb8-9339-9bf5aca17abc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:14.401930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2ff985f4-dcbf-4eb8-9339-9bf5aca17abc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:14.440458 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-6c572c5c-3fae-44b4-b3f6-e2bd78edbbe8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:14.452069 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-6c572c5c-3fae-44b4-b3f6-e2bd78edbbe8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1259 microversion: 2.1 time: 0.428847 Oct 28 19:11:14.453295 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 346/670] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:14 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1259 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:14.459337 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-554b1c21-5385-4d8d-84b6-097f2e4d50a2 req-d3bf8ebd-28a4-4446-bfee-22c5ec3799ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f3f032-9a74-4361-a6e5-8d7a2c09aa1f", "name": "network-vif-deleted", "tag": "2b562495-8684-4c93-b042-c057cbef9900"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:14.476372 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-554b1c21-5385-4d8d-84b6-097f2e4d50a2 req-d3bf8ebd-28a4-4446-bfee-22c5ec3799ba service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:14.477193 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-554b1c21-5385-4d8d-84b6-097f2e4d50a2 req-d3bf8ebd-28a4-4446-bfee-22c5ec3799ba service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:14.477789 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-554b1c21-5385-4d8d-84b6-097f2e4d50a2 req-d3bf8ebd-28a4-4446-bfee-22c5ec3799ba service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:14.493522 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-554b1c21-5385-4d8d-84b6-097f2e4d50a2 req-d3bf8ebd-28a4-4446-bfee-22c5ec3799ba service nova] Creating event network-vif-deleted:2b562495-8684-4c93-b042-c057cbef9900 for instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f on hv-cinder-86236 Oct 28 19:11:14.500854 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-554b1c21-5385-4d8d-84b6-097f2e4d50a2 req-d3bf8ebd-28a4-4446-bfee-22c5ec3799ba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046204 Oct 28 19:11:14.502549 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 347/671] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:14.516716 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2ff985f4-dcbf-4eb8-9339-9bf5aca17abc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:14.527570 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-2ff985f4-dcbf-4eb8-9339-9bf5aca17abc tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 200 len: 1323 microversion: 2.1 time: 0.302358 Oct 28 19:11:14.528687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 325/672] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:14 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 1323 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:15.478324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-de3e9d19-11f9-4cdf-a697-0475a249e7db tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:15.479068 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-de3e9d19-11f9-4cdf-a697-0475a249e7db tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:15.485112 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-de3e9d19-11f9-4cdf-a697-0475a249e7db tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:15.485587 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-de3e9d19-11f9-4cdf-a697-0475a249e7db tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:15.486021 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-de3e9d19-11f9-4cdf-a697-0475a249e7db tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:15.486702 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-de3e9d19-11f9-4cdf-a697-0475a249e7db tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:15.487183 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-de3e9d19-11f9-4cdf-a697-0475a249e7db tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:15.487604 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-de3e9d19-11f9-4cdf-a697-0475a249e7db tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:15.551351 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-22004417-4cae-4206-bc23-b104ed3fe244 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:15.551958 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-22004417-4cae-4206-bc23-b104ed3fe244 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:15.558458 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-22004417-4cae-4206-bc23-b104ed3fe244 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:15.558944 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-22004417-4cae-4206-bc23-b104ed3fe244 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:15.559415 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-22004417-4cae-4206-bc23-b104ed3fe244 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:15.560118 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-22004417-4cae-4206-bc23-b104ed3fe244 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:15.560578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-22004417-4cae-4206-bc23-b104ed3fe244 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:15.561004 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-22004417-4cae-4206-bc23-b104ed3fe244 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:15.574947 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.wsgi [None req-22004417-4cae-4206-bc23-b104ed3fe244 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] HTTP exception thrown: Instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f could not be found. Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-22004417-4cae-4206-bc23-b104ed3fe244 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Request method failure captured: Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: request: GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f HTTP/1.1 Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept: application/json Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept-Encoding: identity Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Connection: close Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Length: 0 Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Type: application/json Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Host: 10.222.0.58 Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Openstack-System-Scope: None Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Auth-Token: gAAAAABjXCglmEo7fINkkMN3YKg4KhgV2NyFPFAlZQESiu85F_1iCqT5NHwD9mIgMUzIG0k5-3DsiGL7OOAGkzifQfgrsdmaW0oYpaV8M71YYnLAGW5bJiNQFkKHuiCYse70Fx5C_fEphacvWMZuiRww2MI4zQj-0rWDy-1wyQJSBNDPK6dEkm8 Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Id: None Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Name: None Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Identity-Status: Confirmed Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Is-Admin-Project: True Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Id: default Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Name: Default Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Id: 526aaf60dd6c42808951c5f48f8fabd2 Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Name: tempest-AttachVolumeTestJSON-37174478 Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Role: member,reader Oct 28 19:11:15.576602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Roles: member,reader Oct 28 19:11:15.578130 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:11:15.578130 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant: tempest-AttachVolumeTestJSON-37174478 Oct 28 19:11:15.578130 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Id: 526aaf60dd6c42808951c5f48f8fabd2 Oct 28 19:11:15.578130 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Name: tempest-AttachVolumeTestJSON-37174478 Oct 28 19:11:15.578130 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User: tempest-AttachVolumeTestJSON-37174478-project Oct 28 19:11:15.578130 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Id: default Oct 28 19:11:15.578130 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Name: Default Oct 28 19:11:15.578130 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Id: a25c8936b368477880f429e818a321fa Oct 28 19:11:15.578130 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Name: tempest-AttachVolumeTestJSON-37174478-project Oct 28 19:11:15.578130 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: method: > Oct 28 19:11:15.578130 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: exception: Instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f could not be found. Oct 28 19:11:15.578130 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: action_args: {'id': '13f3f032-9a74-4361-a6e5-8d7a2c09aa1f'} Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f could not be found. Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:15.578940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:15.581758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:15.581758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:11:15.581758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:11:15.581758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:11:15.581758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:11:15.581758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:11:15.581758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:11:15.581758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f could not be found. Oct 28 19:11:15.581758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:11:15.581758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:15.581758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:11:15.581758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:15.581758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:15.581758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:15.581758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:11:15.581758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:11:15.581758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f could not be found. Oct 28 19:11:15.581758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:11:15.583786 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-22004417-4cae-4206-bc23-b104ed3fe244 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Returning 404 to user: Instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f could not be found. {{(pid=118875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:15.583786 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-22004417-4cae-4206-bc23-b104ed3fe244 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 404 len: 111 microversion: 2.1 time: 0.030684 Oct 28 19:11:15.583786 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 326/673] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:15 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:11:15.587194 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d8d79357-61b4-4467-a9ad-11576ec8dd38 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '.version_select at 0x7f9bf657de50>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:15.591738 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d8d79357-61b4-4467-a9ad-11576ec8dd38 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [fa525cc3-50b3-47d7-8b15-70b20a8caf78] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:11:15.622636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-de3e9d19-11f9-4cdf-a697-0475a249e7db tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:15.630943 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-de3e9d19-11f9-4cdf-a697-0475a249e7db tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1259 microversion: 2.1 time: 0.156885 Oct 28 19:11:15.631545 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 348/674] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:15 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:16.598696 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO oslo.messaging._drivers.impl_rabbit [None req-d8d79357-61b4-4467-a9ad-11576ec8dd38 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [fa525cc3-50b3-47d7-8b15-70b20a8caf78] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 54152. Oct 28 19:11:16.620443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d8d79357-61b4-4467-a9ad-11576ec8dd38 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647481399" status: 202 len: 0 microversion: 2.1 time: 1.036933 Oct 28 19:11:16.621202 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 327/675] 10.222.0.58 () {58 vars in 1221 bytes} [Fri Oct 28 19:11:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647481399 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:11:16.654602 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-87828987-f5e2-4e7e-92fb-5e59e65162b6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:16.655311 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-87828987-f5e2-4e7e-92fb-5e59e65162b6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:16.661785 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-87828987-f5e2-4e7e-92fb-5e59e65162b6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:16.662260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-87828987-f5e2-4e7e-92fb-5e59e65162b6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:16.662692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-87828987-f5e2-4e7e-92fb-5e59e65162b6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:16.663398 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-87828987-f5e2-4e7e-92fb-5e59e65162b6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:16.663845 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-87828987-f5e2-4e7e-92fb-5e59e65162b6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:16.664263 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-87828987-f5e2-4e7e-92fb-5e59e65162b6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:16.834784 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-87828987-f5e2-4e7e-92fb-5e59e65162b6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:16.843416 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-87828987-f5e2-4e7e-92fb-5e59e65162b6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1259 microversion: 2.1 time: 0.192596 Oct 28 19:11:16.844059 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 349/676] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:16 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:17.331958 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-490c4a9b-c2b9-4386-a27b-acabbfb0960c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Action: 'create', calling method: .version_select at 0x7f9bf64c90d0>, body: {"keypair": {"name": "tempest-keypair-12444273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfepOSIfEYcCobv1ijuW2I7RN4uHhV5/J03ZV2hT/v5SBxqYgvCLk0WiZEizyKOdQiSOeqFPqGHOKSGwu3VKPKonAaroiHcWrn/Rvzo7o25pJwOhKqJ15niq2Af9jiSWw=="}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:17.346865 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-490c4a9b-c2b9-4386-a27b-acabbfb0960c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Getting quotas for project 526aaf60dd6c42808951c5f48f8fabd2. Resources: {'key_pairs'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:17.350615 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-490c4a9b-c2b9-4386-a27b-acabbfb0960c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Getting quotas for user a25c8936b368477880f429e818a321fa and project 526aaf60dd6c42808951c5f48f8fabd2. Resources: {'key_pairs'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:17.371889 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-490c4a9b-c2b9-4386-a27b-acabbfb0960c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.044431 Oct 28 19:11:17.372487 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 328/677] 10.222.0.58 () {60 vars in 1159 bytes} [Fri Oct 28 19:11:17 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:17.867020 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-6d152b90-1082-436a-a5c6-b23139362717 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:17.868258 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-6d152b90-1082-436a-a5c6-b23139362717 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:17.874099 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6d152b90-1082-436a-a5c6-b23139362717 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:17.874580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6d152b90-1082-436a-a5c6-b23139362717 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:17.875044 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6d152b90-1082-436a-a5c6-b23139362717 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:17.875738 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6d152b90-1082-436a-a5c6-b23139362717 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:17.876786 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6d152b90-1082-436a-a5c6-b23139362717 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:17.877209 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6d152b90-1082-436a-a5c6-b23139362717 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:18.007472 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-6d152b90-1082-436a-a5c6-b23139362717 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:18.023157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-6d152b90-1082-436a-a5c6-b23139362717 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1259 microversion: 2.1 time: 0.159973 Oct 28 19:11:18.023750 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 350/678] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:17 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:18.601686 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-afe6ece4-0dac-4cca-9eac-67f49e136684 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1595158720", "imageRef": "cd92a575-ed0d-417b-b416-3471be3ba100", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "576c14f7-6c20-4b62-b312-ff07e7f923c3"}], "security_groups": [{"name": "tempest-securitygroup--1897313899"}], "key_name": "tempest-keypair-12444273", "user_data": "}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:18.715686 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.network.neutron [None req-afe6ece4-0dac-4cca-9eac-67f49e136684 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] validate_networks() for [('576c14f7-6c20-4b62-b312-ff07e7f923c3', None, None, None, None, None)] {{(pid=118875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:11:19.045510 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1cbfb637-f761-4cbb-992e-a3a589ad37a4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:19.046109 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-1cbfb637-f761-4cbb-992e-a3a589ad37a4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:19.048569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=2 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:19.049453 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=6 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:19.055042 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cbfb637-f761-4cbb-992e-a3a589ad37a4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:19.055520 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cbfb637-f761-4cbb-992e-a3a589ad37a4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:19.055949 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cbfb637-f761-4cbb-992e-a3a589ad37a4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:19.056634 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cbfb637-f761-4cbb-992e-a3a589ad37a4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:19.057080 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cbfb637-f761-4cbb-992e-a3a589ad37a4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:19.057500 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1cbfb637-f761-4cbb-992e-a3a589ad37a4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:19.160609 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-afe6ece4-0dac-4cca-9eac-67f49e136684 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Flavor limits 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:11:19.161104 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-afe6ece4-0dac-4cca-9eac-67f49e136684 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Image limits 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:11:19.161675 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-afe6ece4-0dac-4cca-9eac-67f49e136684 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Flavor pref 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:11:19.162155 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-afe6ece4-0dac-4cca-9eac-67f49e136684 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Image pref 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:11:19.162655 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-afe6ece4-0dac-4cca-9eac-67f49e136684 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:11:19.172244 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-afe6ece4-0dac-4cca-9eac-67f49e136684 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:19.173375 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-afe6ece4-0dac-4cca-9eac-67f49e136684 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:19.173883 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-afe6ece4-0dac-4cca-9eac-67f49e136684 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:19.174677 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-afe6ece4-0dac-4cca-9eac-67f49e136684 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:19.175232 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-afe6ece4-0dac-4cca-9eac-67f49e136684 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:19.175740 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-afe6ece4-0dac-4cca-9eac-67f49e136684 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:19.195633 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-afe6ece4-0dac-4cca-9eac-67f49e136684 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Getting quotas for project 526aaf60dd6c42808951c5f48f8fabd2. Resources: {'ram', 'instances', 'cores'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:19.199594 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-afe6ece4-0dac-4cca-9eac-67f49e136684 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Getting quotas for user a25c8936b368477880f429e818a321fa and project 526aaf60dd6c42808951c5f48f8fabd2. Resources: {'ram', 'instances', 'cores'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:19.208606 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-1cbfb637-f761-4cbb-992e-a3a589ad37a4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:19.210577 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-afe6ece4-0dac-4cca-9eac-67f49e136684 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Going to run 1 instances... {{(pid=118875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:11:19.212920 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-afe6ece4-0dac-4cca-9eac-67f49e136684 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd92a575-ed0d-417b-b416-3471be3ba100',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:11:19.216433 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-1cbfb637-f761-4cbb-992e-a3a589ad37a4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1259 microversion: 2.1 time: 0.174702 Oct 28 19:11:19.217073 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 351/679] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:19 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:19.265623 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-afe6ece4-0dac-4cca-9eac-67f49e136684 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.668683 Oct 28 19:11:19.266271 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 329/680] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Oct 28 19:11:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:11:19.277396 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-83fccfa3-a5a9-4bb8-adcf-f2a4b290a611 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:19.278003 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-83fccfa3-a5a9-4bb8-adcf-f2a4b290a611 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:19.337509 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-83fccfa3-a5a9-4bb8-adcf-f2a4b290a611 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:19.345098 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-83fccfa3-a5a9-4bb8-adcf-f2a4b290a611 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 200 len: 1236 microversion: 2.1 time: 0.071536 Oct 28 19:11:19.345649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 352/681] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:19 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:19.987473 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-50ea0c9d-6686-4f0d-98c6-ce48b7cc9ef4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:19.987961 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-50ea0c9d-6686-4f0d-98c6-ce48b7cc9ef4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:19.994004 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-50ea0c9d-6686-4f0d-98c6-ce48b7cc9ef4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:19.994484 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-50ea0c9d-6686-4f0d-98c6-ce48b7cc9ef4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:19.994920 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-50ea0c9d-6686-4f0d-98c6-ce48b7cc9ef4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:19.995632 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-50ea0c9d-6686-4f0d-98c6-ce48b7cc9ef4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:19.996079 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-50ea0c9d-6686-4f0d-98c6-ce48b7cc9ef4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:19.996500 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-50ea0c9d-6686-4f0d-98c6-ce48b7cc9ef4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:20.019587 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-50ea0c9d-6686-4f0d-98c6-ce48b7cc9ef4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1/ips" status: 200 len: 152 microversion: 2.20 time: 0.132906 Oct 28 19:11:20.020131 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 330/682] 10.222.0.58 () {60 vars in 1289 bytes} [Fri Oct 28 19:11:19 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1/ips => generated 152 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:11:20.241253 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-6b2a9b43-1c3f-4679-978e-385831aaca74 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:20.241921 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-6b2a9b43-1c3f-4679-978e-385831aaca74 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:20.248815 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6b2a9b43-1c3f-4679-978e-385831aaca74 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:20.249300 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6b2a9b43-1c3f-4679-978e-385831aaca74 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:20.249737 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6b2a9b43-1c3f-4679-978e-385831aaca74 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:20.250425 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6b2a9b43-1c3f-4679-978e-385831aaca74 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:20.251417 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6b2a9b43-1c3f-4679-978e-385831aaca74 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:20.251841 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6b2a9b43-1c3f-4679-978e-385831aaca74 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:20.372694 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-3a2382ce-1617-4806-9c08-5506d416e4a3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:20.373296 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-3a2382ce-1617-4806-9c08-5506d416e4a3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:20.379700 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3a2382ce-1617-4806-9c08-5506d416e4a3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:20.380180 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3a2382ce-1617-4806-9c08-5506d416e4a3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:20.380616 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3a2382ce-1617-4806-9c08-5506d416e4a3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:20.381463 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3a2382ce-1617-4806-9c08-5506d416e4a3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:20.382109 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3a2382ce-1617-4806-9c08-5506d416e4a3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:20.382536 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3a2382ce-1617-4806-9c08-5506d416e4a3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:20.395382 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-6b2a9b43-1c3f-4679-978e-385831aaca74 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:20.404133 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-6b2a9b43-1c3f-4679-978e-385831aaca74 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1259 microversion: 2.1 time: 0.166845 Oct 28 19:11:20.404694 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 353/683] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:20 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:20.448412 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3a2382ce-1617-4806-9c08-5506d416e4a3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:20.457273 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-3a2382ce-1617-4806-9c08-5506d416e4a3 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 200 len: 1232 microversion: 2.1 time: 0.088650 Oct 28 19:11:20.457844 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 331/684] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:20 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 1232 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:21.427233 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-53926450-4e51-4d0b-9949-62fbd6073165 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:21.427838 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-53926450-4e51-4d0b-9949-62fbd6073165 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:21.434178 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-53926450-4e51-4d0b-9949-62fbd6073165 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:21.434663 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-53926450-4e51-4d0b-9949-62fbd6073165 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:21.435122 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-53926450-4e51-4d0b-9949-62fbd6073165 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:21.435824 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-53926450-4e51-4d0b-9949-62fbd6073165 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:21.436269 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-53926450-4e51-4d0b-9949-62fbd6073165 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:21.436689 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-53926450-4e51-4d0b-9949-62fbd6073165 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:21.480300 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-bdfaaf8e-b317-4a45-b44b-1950278fdd3a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:21.481242 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-bdfaaf8e-b317-4a45-b44b-1950278fdd3a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:21.488657 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bdfaaf8e-b317-4a45-b44b-1950278fdd3a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:21.489154 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bdfaaf8e-b317-4a45-b44b-1950278fdd3a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:21.489602 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bdfaaf8e-b317-4a45-b44b-1950278fdd3a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:21.490525 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bdfaaf8e-b317-4a45-b44b-1950278fdd3a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:21.491089 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bdfaaf8e-b317-4a45-b44b-1950278fdd3a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:21.491529 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-bdfaaf8e-b317-4a45-b44b-1950278fdd3a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:21.573496 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-bdfaaf8e-b317-4a45-b44b-1950278fdd3a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:21.582228 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-bdfaaf8e-b317-4a45-b44b-1950278fdd3a tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 200 len: 1294 microversion: 2.1 time: 0.105464 Oct 28 19:11:21.582793 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 332/685] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:21 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 1294 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:21.620260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-53926450-4e51-4d0b-9949-62fbd6073165 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:21.628609 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-53926450-4e51-4d0b-9949-62fbd6073165 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1259 microversion: 2.1 time: 0.205322 Oct 28 19:11:21.629191 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 354/686] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:21 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1259 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:22.563233 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-8837221b-e33b-4f1e-a0fd-2d6da7be2ff7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:22.563783 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-8837221b-e33b-4f1e-a0fd-2d6da7be2ff7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:22.570805 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8837221b-e33b-4f1e-a0fd-2d6da7be2ff7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:22.571324 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8837221b-e33b-4f1e-a0fd-2d6da7be2ff7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:22.571802 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8837221b-e33b-4f1e-a0fd-2d6da7be2ff7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:22.572500 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8837221b-e33b-4f1e-a0fd-2d6da7be2ff7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:22.573303 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8837221b-e33b-4f1e-a0fd-2d6da7be2ff7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:22.573734 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8837221b-e33b-4f1e-a0fd-2d6da7be2ff7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:22.596955 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.objects.instance [None req-8837221b-e33b-4f1e-a0fd-2d6da7be2ff7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lazy-loading 'flavor' on Instance uuid 46c2187f-f4f1-4d25-96ff-2b032986f8b1 {{(pid=118875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:22.604711 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-866dd541-0e3f-4c8b-8108-5c1a8ca198d6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:22.605949 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-866dd541-0e3f-4c8b-8108-5c1a8ca198d6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:22.612459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-866dd541-0e3f-4c8b-8108-5c1a8ca198d6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:22.613096 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-866dd541-0e3f-4c8b-8108-5c1a8ca198d6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:22.613624 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-866dd541-0e3f-4c8b-8108-5c1a8ca198d6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:22.614421 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-866dd541-0e3f-4c8b-8108-5c1a8ca198d6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:22.615141 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-866dd541-0e3f-4c8b-8108-5c1a8ca198d6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:22.615634 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-866dd541-0e3f-4c8b-8108-5c1a8ca198d6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:22.764796 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-866dd541-0e3f-4c8b-8108-5c1a8ca198d6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:22.776159 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-866dd541-0e3f-4c8b-8108-5c1a8ca198d6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 200 len: 1362 microversion: 2.1 time: 0.174225 Oct 28 19:11:22.777989 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 355/687] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:22 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:22.787772 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1a437e09-701d-47da-983a-4d18f7132408 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:22.788770 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-1a437e09-701d-47da-983a-4d18f7132408 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:22.796991 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1a437e09-701d-47da-983a-4d18f7132408 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:22.797725 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1a437e09-701d-47da-983a-4d18f7132408 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:22.798290 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1a437e09-701d-47da-983a-4d18f7132408 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:22.800107 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1a437e09-701d-47da-983a-4d18f7132408 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:22.800588 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1a437e09-701d-47da-983a-4d18f7132408 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:22.801021 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1a437e09-701d-47da-983a-4d18f7132408 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:22.833840 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-8837221b-e33b-4f1e-a0fd-2d6da7be2ff7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "POST /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1/action" status: 202 len: 0 microversion: 2.20 time: 0.274443 Oct 28 19:11:22.834557 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 333/688] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Oct 28 19:11:22 2022] POST /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:11:22.857042 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-38bfdf8a-2e3b-4f2e-86e2-133aad8dcbb7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:22.858709 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-38bfdf8a-2e3b-4f2e-86e2-133aad8dcbb7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:22.867519 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-38bfdf8a-2e3b-4f2e-86e2-133aad8dcbb7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:22.868413 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-38bfdf8a-2e3b-4f2e-86e2-133aad8dcbb7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:22.868853 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-38bfdf8a-2e3b-4f2e-86e2-133aad8dcbb7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:22.869553 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-38bfdf8a-2e3b-4f2e-86e2-133aad8dcbb7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:22.870224 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-38bfdf8a-2e3b-4f2e-86e2-133aad8dcbb7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:22.870584 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-38bfdf8a-2e3b-4f2e-86e2-133aad8dcbb7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:23.005523 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-1a437e09-701d-47da-983a-4d18f7132408 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:23.013719 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-1a437e09-701d-47da-983a-4d18f7132408 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1259 microversion: 2.1 time: 0.234511 Oct 28 19:11:23.014300 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 356/689] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:22 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:23.018775 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-a4bd3d17-0446-4d40-a6d3-38fbb3a09d25 req-fea351d8-16a7-47f5-b199-e504414d445a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b9469f-9d6c-44e5-a945-1ef18dd7e49c", "tag": "82fe4e85-bafc-41b9-aefe-cc9b20740a81"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:23.027936 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-a4bd3d17-0446-4d40-a6d3-38fbb3a09d25 req-fea351d8-16a7-47f5-b199-e504414d445a service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:23.028410 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-a4bd3d17-0446-4d40-a6d3-38fbb3a09d25 req-fea351d8-16a7-47f5-b199-e504414d445a service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:23.028841 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-a4bd3d17-0446-4d40-a6d3-38fbb3a09d25 req-fea351d8-16a7-47f5-b199-e504414d445a service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:23.040192 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-a4bd3d17-0446-4d40-a6d3-38fbb3a09d25 req-fea351d8-16a7-47f5-b199-e504414d445a service nova] Creating event network-changed:82fe4e85-bafc-41b9-aefe-cc9b20740a81 for instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c on hv-cinder-86236 Oct 28 19:11:23.046369 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-38bfdf8a-2e3b-4f2e-86e2-133aad8dcbb7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:23.046602 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-a4bd3d17-0446-4d40-a6d3-38fbb3a09d25 req-fea351d8-16a7-47f5-b199-e504414d445a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030966 Oct 28 19:11:23.047512 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 357/690] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:23.056211 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-38bfdf8a-2e3b-4f2e-86e2-133aad8dcbb7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:23.057801 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-38bfdf8a-2e3b-4f2e-86e2-133aad8dcbb7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:23.059021 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-38bfdf8a-2e3b-4f2e-86e2-133aad8dcbb7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1722 microversion: 2.20 time: 0.220145 Oct 28 19:11:23.059585 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 334/691] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:22 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:11:23.293328 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-6d2a79e0-3041-43f0-a735-954dd2b2158b req-6bb19967-e39e-48b8-85c0-e4e56ddda12c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "429f9d21-c184-4baa-b7ea-bd94656890f3", "name": "network-vif-plugged", "status": "completed", "tag": "47bb3174-db66-4aef-9eaa-fa1018a14bec"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:23.303461 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-6d2a79e0-3041-43f0-a735-954dd2b2158b req-6bb19967-e39e-48b8-85c0-e4e56ddda12c service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:23.303926 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-6d2a79e0-3041-43f0-a735-954dd2b2158b req-6bb19967-e39e-48b8-85c0-e4e56ddda12c service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:23.304356 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-6d2a79e0-3041-43f0-a735-954dd2b2158b req-6bb19967-e39e-48b8-85c0-e4e56ddda12c service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:23.318705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-6d2a79e0-3041-43f0-a735-954dd2b2158b req-6bb19967-e39e-48b8-85c0-e4e56ddda12c service nova] Creating event network-vif-plugged:47bb3174-db66-4aef-9eaa-fa1018a14bec for instance 429f9d21-c184-4baa-b7ea-bd94656890f3 on hv-cinder-86236 Oct 28 19:11:23.323430 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-6d2a79e0-3041-43f0-a735-954dd2b2158b req-6bb19967-e39e-48b8-85c0-e4e56ddda12c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034211 Oct 28 19:11:23.324232 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 358/692] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:23.800652 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-38044cb9-f499-4f7c-ac24-80bdf3a218ae tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:23.801395 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-38044cb9-f499-4f7c-ac24-80bdf3a218ae tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:23.808004 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-38044cb9-f499-4f7c-ac24-80bdf3a218ae tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:23.808495 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-38044cb9-f499-4f7c-ac24-80bdf3a218ae tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:23.808941 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-38044cb9-f499-4f7c-ac24-80bdf3a218ae tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:23.809639 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-38044cb9-f499-4f7c-ac24-80bdf3a218ae tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:23.810098 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-38044cb9-f499-4f7c-ac24-80bdf3a218ae tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:23.810528 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-38044cb9-f499-4f7c-ac24-80bdf3a218ae tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:23.938583 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-38044cb9-f499-4f7c-ac24-80bdf3a218ae tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:23.946766 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-38044cb9-f499-4f7c-ac24-80bdf3a218ae tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 200 len: 1362 microversion: 2.1 time: 0.150031 Oct 28 19:11:23.947375 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 335/693] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:23 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:24.037547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-18d2dffd-e684-4263-baeb-542a8f6234ab tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:24.038226 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-18d2dffd-e684-4263-baeb-542a8f6234ab tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:24.044437 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-18d2dffd-e684-4263-baeb-542a8f6234ab tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:24.044907 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-18d2dffd-e684-4263-baeb-542a8f6234ab tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:24.045340 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-18d2dffd-e684-4263-baeb-542a8f6234ab tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:24.046016 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-18d2dffd-e684-4263-baeb-542a8f6234ab tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:24.046460 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-18d2dffd-e684-4263-baeb-542a8f6234ab tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:24.046876 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-18d2dffd-e684-4263-baeb-542a8f6234ab tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:24.084865 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-58e224d8-770c-4b4c-8402-b14e527a0e74 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:24.085571 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-58e224d8-770c-4b4c-8402-b14e527a0e74 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:24.091791 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-58e224d8-770c-4b4c-8402-b14e527a0e74 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:24.092350 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-58e224d8-770c-4b4c-8402-b14e527a0e74 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:24.092861 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-58e224d8-770c-4b4c-8402-b14e527a0e74 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:24.093634 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-58e224d8-770c-4b4c-8402-b14e527a0e74 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:24.094161 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-58e224d8-770c-4b4c-8402-b14e527a0e74 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:24.094683 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-58e224d8-770c-4b4c-8402-b14e527a0e74 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:24.234544 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-18d2dffd-e684-4263-baeb-542a8f6234ab tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:24.242884 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-18d2dffd-e684-4263-baeb-542a8f6234ab tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1259 microversion: 2.1 time: 0.209552 Oct 28 19:11:24.243567 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 359/694] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:24 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1259 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:24.256676 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-58e224d8-770c-4b4c-8402-b14e527a0e74 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:24.265443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-58e224d8-770c-4b4c-8402-b14e527a0e74 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:24.266885 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-58e224d8-770c-4b4c-8402-b14e527a0e74 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:24.268103 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-58e224d8-770c-4b4c-8402-b14e527a0e74 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1722 microversion: 2.20 time: 0.187790 Oct 28 19:11:24.268655 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 336/695] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:24 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:11:24.969917 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-2d641baf-abfb-45da-8559-852d21252749 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:24.970525 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-2d641baf-abfb-45da-8559-852d21252749 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:24.976382 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2d641baf-abfb-45da-8559-852d21252749 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:24.976865 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2d641baf-abfb-45da-8559-852d21252749 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:24.977298 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2d641baf-abfb-45da-8559-852d21252749 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:24.977980 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2d641baf-abfb-45da-8559-852d21252749 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:24.978433 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2d641baf-abfb-45da-8559-852d21252749 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:24.978859 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2d641baf-abfb-45da-8559-852d21252749 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:24.982913 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=100 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:25.110093 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-2d641baf-abfb-45da-8559-852d21252749 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:25.118269 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-2d641baf-abfb-45da-8559-852d21252749 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 200 len: 1362 microversion: 2.1 time: 0.152397 Oct 28 19:11:25.118841 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 360/696] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:24 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:25.266346 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-ee70e538-fdb1-4b47-bb2f-4d6e610d2f4d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:25.266949 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-ee70e538-fdb1-4b47-bb2f-4d6e610d2f4d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:25.273427 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ee70e538-fdb1-4b47-bb2f-4d6e610d2f4d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:25.274064 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ee70e538-fdb1-4b47-bb2f-4d6e610d2f4d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:25.274502 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ee70e538-fdb1-4b47-bb2f-4d6e610d2f4d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:25.275217 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ee70e538-fdb1-4b47-bb2f-4d6e610d2f4d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:25.275675 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ee70e538-fdb1-4b47-bb2f-4d6e610d2f4d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:25.276094 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ee70e538-fdb1-4b47-bb2f-4d6e610d2f4d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:25.280021 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:25.293374 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-de1a2209-80b5-4568-b967-1144d13a37e9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:25.294096 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-de1a2209-80b5-4568-b967-1144d13a37e9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:25.300741 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-de1a2209-80b5-4568-b967-1144d13a37e9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:25.301216 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-de1a2209-80b5-4568-b967-1144d13a37e9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:25.301646 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-de1a2209-80b5-4568-b967-1144d13a37e9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:25.302327 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-de1a2209-80b5-4568-b967-1144d13a37e9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:25.302774 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-de1a2209-80b5-4568-b967-1144d13a37e9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:25.303223 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-de1a2209-80b5-4568-b967-1144d13a37e9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:25.463183 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ee70e538-fdb1-4b47-bb2f-4d6e610d2f4d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:25.471753 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-ee70e538-fdb1-4b47-bb2f-4d6e610d2f4d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1259 microversion: 2.1 time: 0.209161 Oct 28 19:11:25.472554 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 337/697] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:25 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1259 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:25.489418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-de1a2209-80b5-4568-b967-1144d13a37e9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:25.497557 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-de1a2209-80b5-4568-b967-1144d13a37e9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:25.499346 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-de1a2209-80b5-4568-b967-1144d13a37e9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:25.500793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-de1a2209-80b5-4568-b967-1144d13a37e9 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1722 microversion: 2.20 time: 0.211543 Oct 28 19:11:25.501350 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 361/698] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:25 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:11:26.141416 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-3bdfeb92-51b6-4345-ad5d-ab1a32405551 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:26.142024 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-3bdfeb92-51b6-4345-ad5d-ab1a32405551 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:26.144550 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:26.150759 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3bdfeb92-51b6-4345-ad5d-ab1a32405551 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.151273 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3bdfeb92-51b6-4345-ad5d-ab1a32405551 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.151746 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3bdfeb92-51b6-4345-ad5d-ab1a32405551 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.152448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3bdfeb92-51b6-4345-ad5d-ab1a32405551 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.152902 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3bdfeb92-51b6-4345-ad5d-ab1a32405551 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.153326 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3bdfeb92-51b6-4345-ad5d-ab1a32405551 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.281781 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3bdfeb92-51b6-4345-ad5d-ab1a32405551 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:26.289423 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-3bdfeb92-51b6-4345-ad5d-ab1a32405551 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 200 len: 1362 microversion: 2.1 time: 0.151824 Oct 28 19:11:26.290000 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 338/699] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:26 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:26.495515 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-53e0dffb-7060-424e-9a82-b6b48d585622 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:26.496056 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-53e0dffb-7060-424e-9a82-b6b48d585622 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:26.502962 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-53e0dffb-7060-424e-9a82-b6b48d585622 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.503479 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-53e0dffb-7060-424e-9a82-b6b48d585622 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.503911 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-53e0dffb-7060-424e-9a82-b6b48d585622 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.504598 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-53e0dffb-7060-424e-9a82-b6b48d585622 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.505051 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-53e0dffb-7060-424e-9a82-b6b48d585622 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.505470 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-53e0dffb-7060-424e-9a82-b6b48d585622 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.525718 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-5740c67a-461e-469d-b4f7-f0ecd40f4b97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:26.526315 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-5740c67a-461e-469d-b4f7-f0ecd40f4b97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:26.532135 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5740c67a-461e-469d-b4f7-f0ecd40f4b97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.532618 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5740c67a-461e-469d-b4f7-f0ecd40f4b97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.533141 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5740c67a-461e-469d-b4f7-f0ecd40f4b97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.533837 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5740c67a-461e-469d-b4f7-f0ecd40f4b97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.534284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5740c67a-461e-469d-b4f7-f0ecd40f4b97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.534711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5740c67a-461e-469d-b4f7-f0ecd40f4b97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.697115 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-53e0dffb-7060-424e-9a82-b6b48d585622 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:26.706281 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-53e0dffb-7060-424e-9a82-b6b48d585622 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1441 microversion: 2.1 time: 0.214850 Oct 28 19:11:26.706875 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 362/700] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:26 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1441 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:26.725806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-5740c67a-461e-469d-b4f7-f0ecd40f4b97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:26.729899 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-c1f89b1e-0b76-4447-b0f7-7c6cbebbc819 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:26.730519 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-c1f89b1e-0b76-4447-b0f7-7c6cbebbc819 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:26.734562 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-5740c67a-461e-469d-b4f7-f0ecd40f4b97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:26.736823 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-5740c67a-461e-469d-b4f7-f0ecd40f4b97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:26.737975 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c1f89b1e-0b76-4447-b0f7-7c6cbebbc819 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.738310 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-5740c67a-461e-469d-b4f7-f0ecd40f4b97 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1722 microversion: 2.20 time: 0.216293 Oct 28 19:11:26.738607 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c1f89b1e-0b76-4447-b0f7-7c6cbebbc819 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.738868 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 339/701] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:26 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:11:26.739025 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c1f89b1e-0b76-4447-b0f7-7c6cbebbc819 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.739853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c1f89b1e-0b76-4447-b0f7-7c6cbebbc819 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.740426 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c1f89b1e-0b76-4447-b0f7-7c6cbebbc819 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.740901 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c1f89b1e-0b76-4447-b0f7-7c6cbebbc819 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.892638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-c1f89b1e-0b76-4447-b0f7-7c6cbebbc819 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:26.900554 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-c1f89b1e-0b76-4447-b0f7-7c6cbebbc819 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1441 microversion: 2.1 time: 0.175459 Oct 28 19:11:26.901131 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 363/702] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:26 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1441 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:27.312559 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-e9f63256-d42c-4f26-a3aa-8178052a933d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:27.313163 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-e9f63256-d42c-4f26-a3aa-8178052a933d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:27.321090 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e9f63256-d42c-4f26-a3aa-8178052a933d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.321090 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e9f63256-d42c-4f26-a3aa-8178052a933d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.321560 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e9f63256-d42c-4f26-a3aa-8178052a933d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.322328 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e9f63256-d42c-4f26-a3aa-8178052a933d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.322839 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e9f63256-d42c-4f26-a3aa-8178052a933d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.323308 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e9f63256-d42c-4f26-a3aa-8178052a933d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.487759 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-e9f63256-d42c-4f26-a3aa-8178052a933d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:27.496298 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-e9f63256-d42c-4f26-a3aa-8178052a933d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 200 len: 1362 microversion: 2.1 time: 0.187658 Oct 28 19:11:27.496900 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 340/703] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:27 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:27.765802 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-43f8e2d8-24ce-41ec-b6a0-bd1133cd3322 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:27.767009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-43f8e2d8-24ce-41ec-b6a0-bd1133cd3322 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:27.773329 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-43f8e2d8-24ce-41ec-b6a0-bd1133cd3322 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.773925 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-43f8e2d8-24ce-41ec-b6a0-bd1133cd3322 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.774475 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-43f8e2d8-24ce-41ec-b6a0-bd1133cd3322 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.775300 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-43f8e2d8-24ce-41ec-b6a0-bd1133cd3322 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.775855 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-43f8e2d8-24ce-41ec-b6a0-bd1133cd3322 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.776407 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-43f8e2d8-24ce-41ec-b6a0-bd1133cd3322 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.937787 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-43f8e2d8-24ce-41ec-b6a0-bd1133cd3322 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:27.945986 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-43f8e2d8-24ce-41ec-b6a0-bd1133cd3322 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:27.947589 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-43f8e2d8-24ce-41ec-b6a0-bd1133cd3322 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:27.948864 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-43f8e2d8-24ce-41ec-b6a0-bd1133cd3322 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1722 microversion: 2.20 time: 0.187217 Oct 28 19:11:27.949425 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 364/704] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:27 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:28.524048 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-7f8e3050-9f66-4962-b670-69e7694ad6d5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:28.524656 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-7f8e3050-9f66-4962-b670-69e7694ad6d5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:28.530677 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7f8e3050-9f66-4962-b670-69e7694ad6d5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:28.531203 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7f8e3050-9f66-4962-b670-69e7694ad6d5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:28.531642 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7f8e3050-9f66-4962-b670-69e7694ad6d5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:28.532329 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7f8e3050-9f66-4962-b670-69e7694ad6d5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:28.532815 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7f8e3050-9f66-4962-b670-69e7694ad6d5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:28.533736 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7f8e3050-9f66-4962-b670-69e7694ad6d5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:28.678635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-7f8e3050-9f66-4962-b670-69e7694ad6d5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:28.687221 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-7f8e3050-9f66-4962-b670-69e7694ad6d5 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 200 len: 1362 microversion: 2.1 time: 0.166987 Oct 28 19:11:28.688296 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 341/705] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:28 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:28.733988 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-4d400bef-daeb-4de6-8779-3f2ce4cd4b18 req-d8459fed-ace0-44f3-b332-df867aadf7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "429f9d21-c184-4baa-b7ea-bd94656890f3", "tag": "47bb3174-db66-4aef-9eaa-fa1018a14bec"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:28.743957 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-4d400bef-daeb-4de6-8779-3f2ce4cd4b18 req-d8459fed-ace0-44f3-b332-df867aadf7a1 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:28.744428 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-4d400bef-daeb-4de6-8779-3f2ce4cd4b18 req-d8459fed-ace0-44f3-b332-df867aadf7a1 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:28.744853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-4d400bef-daeb-4de6-8779-3f2ce4cd4b18 req-d8459fed-ace0-44f3-b332-df867aadf7a1 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:28.756114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-4d400bef-daeb-4de6-8779-3f2ce4cd4b18 req-d8459fed-ace0-44f3-b332-df867aadf7a1 service nova] Creating event network-changed:47bb3174-db66-4aef-9eaa-fa1018a14bec for instance 429f9d21-c184-4baa-b7ea-bd94656890f3 on hv-cinder-86236 Oct 28 19:11:28.761269 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-4d400bef-daeb-4de6-8779-3f2ce4cd4b18 req-d8459fed-ace0-44f3-b332-df867aadf7a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094517 Oct 28 19:11:28.761859 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 365/706] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:28.973872 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-6bf364a5-0a61-4f59-bbd0-353e83cfa26f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:28.974473 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-6bf364a5-0a61-4f59-bbd0-353e83cfa26f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:28.980654 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6bf364a5-0a61-4f59-bbd0-353e83cfa26f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:28.981138 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6bf364a5-0a61-4f59-bbd0-353e83cfa26f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:28.981786 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6bf364a5-0a61-4f59-bbd0-353e83cfa26f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:28.982501 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6bf364a5-0a61-4f59-bbd0-353e83cfa26f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:28.982955 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6bf364a5-0a61-4f59-bbd0-353e83cfa26f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:28.983418 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6bf364a5-0a61-4f59-bbd0-353e83cfa26f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:29.126053 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-6bf364a5-0a61-4f59-bbd0-353e83cfa26f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:29.137887 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-6bf364a5-0a61-4f59-bbd0-353e83cfa26f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:29.139704 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-6bf364a5-0a61-4f59-bbd0-353e83cfa26f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:29.141063 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-6bf364a5-0a61-4f59-bbd0-353e83cfa26f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1722 microversion: 2.20 time: 0.171682 Oct 28 19:11:29.141692 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 342/707] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:28 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:29.329877 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-a0248c7d-3875-4b5e-9088-395acd926a4a req-dde73fce-bb03-497e-8ef4-3fb7ca703577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b9469f-9d6c-44e5-a945-1ef18dd7e49c", "name": "network-vif-plugged", "status": "completed", "tag": "82fe4e85-bafc-41b9-aefe-cc9b20740a81"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:29.341085 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-a0248c7d-3875-4b5e-9088-395acd926a4a req-dde73fce-bb03-497e-8ef4-3fb7ca703577 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:29.341966 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-a0248c7d-3875-4b5e-9088-395acd926a4a req-dde73fce-bb03-497e-8ef4-3fb7ca703577 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:29.342799 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-a0248c7d-3875-4b5e-9088-395acd926a4a req-dde73fce-bb03-497e-8ef4-3fb7ca703577 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:29.353671 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=2 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:29.356205 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-a0248c7d-3875-4b5e-9088-395acd926a4a req-dde73fce-bb03-497e-8ef4-3fb7ca703577 service nova] Creating event network-vif-plugged:82fe4e85-bafc-41b9-aefe-cc9b20740a81 for instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c on hv-cinder-86236 Oct 28 19:11:29.362109 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-a0248c7d-3875-4b5e-9088-395acd926a4a req-dde73fce-bb03-497e-8ef4-3fb7ca703577 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036979 Oct 28 19:11:29.363393 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 366/708] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:11:29.710424 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-682bbeec-9689-4f09-918b-350dd3435c34 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:29.711037 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-682bbeec-9689-4f09-918b-350dd3435c34 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:29.712909 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell0:SELECT=2 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:29.713569 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell0:SELECT=12 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:29.720099 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-682bbeec-9689-4f09-918b-350dd3435c34 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:29.720686 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-682bbeec-9689-4f09-918b-350dd3435c34 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:29.721127 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-682bbeec-9689-4f09-918b-350dd3435c34 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:29.721827 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-682bbeec-9689-4f09-918b-350dd3435c34 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:29.722284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-682bbeec-9689-4f09-918b-350dd3435c34 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:29.722805 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-682bbeec-9689-4f09-918b-350dd3435c34 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:29.867931 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-682bbeec-9689-4f09-918b-350dd3435c34 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:29.875791 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-682bbeec-9689-4f09-918b-350dd3435c34 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 200 len: 1362 microversion: 2.1 time: 0.169531 Oct 28 19:11:29.876372 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 343/709] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:29 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:30.167210 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-0c869536-1c12-45bb-8b4a-49da185dd1fb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:30.167785 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-0c869536-1c12-45bb-8b4a-49da185dd1fb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:30.173819 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0c869536-1c12-45bb-8b4a-49da185dd1fb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:30.174294 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0c869536-1c12-45bb-8b4a-49da185dd1fb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:30.174723 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0c869536-1c12-45bb-8b4a-49da185dd1fb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:30.175432 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0c869536-1c12-45bb-8b4a-49da185dd1fb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:30.175877 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0c869536-1c12-45bb-8b4a-49da185dd1fb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:30.176298 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0c869536-1c12-45bb-8b4a-49da185dd1fb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:30.310435 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-0c869536-1c12-45bb-8b4a-49da185dd1fb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:30.319059 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-0c869536-1c12-45bb-8b4a-49da185dd1fb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:30.320502 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-0c869536-1c12-45bb-8b4a-49da185dd1fb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:30.321643 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-0c869536-1c12-45bb-8b4a-49da185dd1fb tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1722 microversion: 2.20 time: 0.159089 Oct 28 19:11:30.322197 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 367/710] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:30 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:30.899540 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-17e6d2e0-f4cd-4c53-a52d-45f80d2a043b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:30.900091 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-17e6d2e0-f4cd-4c53-a52d-45f80d2a043b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:30.906385 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-17e6d2e0-f4cd-4c53-a52d-45f80d2a043b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:30.906865 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-17e6d2e0-f4cd-4c53-a52d-45f80d2a043b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:30.907341 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-17e6d2e0-f4cd-4c53-a52d-45f80d2a043b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:30.908029 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-17e6d2e0-f4cd-4c53-a52d-45f80d2a043b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:30.908485 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-17e6d2e0-f4cd-4c53-a52d-45f80d2a043b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:30.908906 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-17e6d2e0-f4cd-4c53-a52d-45f80d2a043b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:31.035264 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-17e6d2e0-f4cd-4c53-a52d-45f80d2a043b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:31.042760 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-17e6d2e0-f4cd-4c53-a52d-45f80d2a043b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 200 len: 1362 microversion: 2.1 time: 0.147151 Oct 28 19:11:31.043356 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 344/711] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:30 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:31.347327 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-96a33e38-7354-47f1-b326-3ac893b6376f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:31.348308 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-96a33e38-7354-47f1-b326-3ac893b6376f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:31.354133 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-96a33e38-7354-47f1-b326-3ac893b6376f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:31.354688 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-96a33e38-7354-47f1-b326-3ac893b6376f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:31.355231 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-96a33e38-7354-47f1-b326-3ac893b6376f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:31.355947 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-96a33e38-7354-47f1-b326-3ac893b6376f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:31.356395 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-96a33e38-7354-47f1-b326-3ac893b6376f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:31.356815 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-96a33e38-7354-47f1-b326-3ac893b6376f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:31.495881 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-96a33e38-7354-47f1-b326-3ac893b6376f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:31.505613 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-96a33e38-7354-47f1-b326-3ac893b6376f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:31.507437 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-96a33e38-7354-47f1-b326-3ac893b6376f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:31.509138 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-96a33e38-7354-47f1-b326-3ac893b6376f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1722 microversion: 2.20 time: 0.165981 Oct 28 19:11:31.509701 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 368/712] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:31 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:32.066269 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-0f95625d-f268-4b1d-ad10-6f5127514b29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:32.066887 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-0f95625d-f268-4b1d-ad10-6f5127514b29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:32.073340 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0f95625d-f268-4b1d-ad10-6f5127514b29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:32.073822 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0f95625d-f268-4b1d-ad10-6f5127514b29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:32.074262 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0f95625d-f268-4b1d-ad10-6f5127514b29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:32.074997 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0f95625d-f268-4b1d-ad10-6f5127514b29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:32.075465 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0f95625d-f268-4b1d-ad10-6f5127514b29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:32.075896 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0f95625d-f268-4b1d-ad10-6f5127514b29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:32.209116 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-0f95625d-f268-4b1d-ad10-6f5127514b29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:32.216723 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-0f95625d-f268-4b1d-ad10-6f5127514b29 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 200 len: 1549 microversion: 2.1 time: 0.154845 Oct 28 19:11:32.217296 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 345/713] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:32 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:32.238496 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-24f78d77-6a85-4076-a4e2-b034db942a27 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:32.239044 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-24f78d77-6a85-4076-a4e2-b034db942a27 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:32.245306 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-24f78d77-6a85-4076-a4e2-b034db942a27 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:32.245820 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-24f78d77-6a85-4076-a4e2-b034db942a27 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:32.246255 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-24f78d77-6a85-4076-a4e2-b034db942a27 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:32.246943 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-24f78d77-6a85-4076-a4e2-b034db942a27 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:32.247424 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-24f78d77-6a85-4076-a4e2-b034db942a27 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:32.247852 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-24f78d77-6a85-4076-a4e2-b034db942a27 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:32.323537 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-24f78d77-6a85-4076-a4e2-b034db942a27 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088825 Oct 28 19:11:32.324130 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 369/714] 10.222.0.58 () {58 vars in 1275 bytes} [Fri Oct 28 19:11:32 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:32.534262 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-23a61d50-0bb7-4982-a9cc-3465267c8d8a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:32.534865 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-23a61d50-0bb7-4982-a9cc-3465267c8d8a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:32.540718 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-23a61d50-0bb7-4982-a9cc-3465267c8d8a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:32.541540 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-23a61d50-0bb7-4982-a9cc-3465267c8d8a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:32.541977 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-23a61d50-0bb7-4982-a9cc-3465267c8d8a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:32.542666 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-23a61d50-0bb7-4982-a9cc-3465267c8d8a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:32.543137 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-23a61d50-0bb7-4982-a9cc-3465267c8d8a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:32.543561 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-23a61d50-0bb7-4982-a9cc-3465267c8d8a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:32.788712 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-23a61d50-0bb7-4982-a9cc-3465267c8d8a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:32.797913 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-23a61d50-0bb7-4982-a9cc-3465267c8d8a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:32.799502 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-23a61d50-0bb7-4982-a9cc-3465267c8d8a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:32.800751 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-23a61d50-0bb7-4982-a9cc-3465267c8d8a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1722 microversion: 2.20 time: 0.270448 Oct 28 19:11:32.801308 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 346/715] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:32 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:33.380572 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-11a2e4b1-8bda-42a5-8a65-dd8efd8bac1c req-e923f377-6433-42af-8b6e-15aac6d4b615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b9469f-9d6c-44e5-a945-1ef18dd7e49c", "tag": "82fe4e85-bafc-41b9-aefe-cc9b20740a81"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:33.390594 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-11a2e4b1-8bda-42a5-8a65-dd8efd8bac1c req-e923f377-6433-42af-8b6e-15aac6d4b615 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:33.391186 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-11a2e4b1-8bda-42a5-8a65-dd8efd8bac1c req-e923f377-6433-42af-8b6e-15aac6d4b615 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:33.391702 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-11a2e4b1-8bda-42a5-8a65-dd8efd8bac1c req-e923f377-6433-42af-8b6e-15aac6d4b615 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:33.404810 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-11a2e4b1-8bda-42a5-8a65-dd8efd8bac1c req-e923f377-6433-42af-8b6e-15aac6d4b615 service nova] Creating event network-changed:82fe4e85-bafc-41b9-aefe-cc9b20740a81 for instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c on hv-cinder-86236 Oct 28 19:11:33.410503 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-11a2e4b1-8bda-42a5-8a65-dd8efd8bac1c req-e923f377-6433-42af-8b6e-15aac6d4b615 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088098 Oct 28 19:11:33.411743 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 370/716] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:33.826065 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-9af452db-af00-4444-8f06-6a01dc336e4a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:33.826679 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-9af452db-af00-4444-8f06-6a01dc336e4a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:33.833408 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9af452db-af00-4444-8f06-6a01dc336e4a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:33.833893 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9af452db-af00-4444-8f06-6a01dc336e4a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:33.834628 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9af452db-af00-4444-8f06-6a01dc336e4a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:33.835363 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9af452db-af00-4444-8f06-6a01dc336e4a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:33.835810 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9af452db-af00-4444-8f06-6a01dc336e4a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:33.836403 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9af452db-af00-4444-8f06-6a01dc336e4a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:33.978515 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-9af452db-af00-4444-8f06-6a01dc336e4a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:33.988121 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-9af452db-af00-4444-8f06-6a01dc336e4a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:33.990214 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-9af452db-af00-4444-8f06-6a01dc336e4a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:33.991702 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-9af452db-af00-4444-8f06-6a01dc336e4a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1743 microversion: 2.20 time: 0.169863 Oct 28 19:11:33.992375 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 347/717] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:33 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:35.022458 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-6dd637fc-13bd-4d86-bdf5-91723d1523be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:35.023605 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-6dd637fc-13bd-4d86-bdf5-91723d1523be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:35.033939 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6dd637fc-13bd-4d86-bdf5-91723d1523be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:35.034904 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6dd637fc-13bd-4d86-bdf5-91723d1523be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:35.035645 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6dd637fc-13bd-4d86-bdf5-91723d1523be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:35.036769 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6dd637fc-13bd-4d86-bdf5-91723d1523be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:35.037507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6dd637fc-13bd-4d86-bdf5-91723d1523be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:35.038199 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6dd637fc-13bd-4d86-bdf5-91723d1523be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:35.245874 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-6dd637fc-13bd-4d86-bdf5-91723d1523be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:35.254250 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-6dd637fc-13bd-4d86-bdf5-91723d1523be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:35.255752 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-6dd637fc-13bd-4d86-bdf5-91723d1523be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:35.256926 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-6dd637fc-13bd-4d86-bdf5-91723d1523be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1743 microversion: 2.20 time: 0.241949 Oct 28 19:11:35.257492 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 371/718] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:35 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1743 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:36.288751 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-1537133c-4af7-4539-a613-090019998be7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:36.289988 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-1537133c-4af7-4539-a613-090019998be7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:36.296810 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1537133c-4af7-4539-a613-090019998be7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:36.302901 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1537133c-4af7-4539-a613-090019998be7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:36.304205 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1537133c-4af7-4539-a613-090019998be7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:36.304972 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1537133c-4af7-4539-a613-090019998be7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:36.305452 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1537133c-4af7-4539-a613-090019998be7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:36.305887 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1537133c-4af7-4539-a613-090019998be7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:36.344492 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-76b8cdbc-227e-49e1-9c9e-d342c74068b0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:36.345088 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-76b8cdbc-227e-49e1-9c9e-d342c74068b0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:36.357660 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-76b8cdbc-227e-49e1-9c9e-d342c74068b0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:36.358181 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-76b8cdbc-227e-49e1-9c9e-d342c74068b0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:36.358631 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-76b8cdbc-227e-49e1-9c9e-d342c74068b0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:36.359357 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-76b8cdbc-227e-49e1-9c9e-d342c74068b0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:36.359894 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-76b8cdbc-227e-49e1-9c9e-d342c74068b0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:36.360325 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-76b8cdbc-227e-49e1-9c9e-d342c74068b0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:36.485525 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.objects.instance [None req-76b8cdbc-227e-49e1-9c9e-d342c74068b0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lazy-loading 'services' on Instance uuid 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f {{(pid=118874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:36.492532 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1537133c-4af7-4539-a613-090019998be7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:36.515277 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1537133c-4af7-4539-a613-090019998be7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:36.517893 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1537133c-4af7-4539-a613-090019998be7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:36.519395 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-1537133c-4af7-4539-a613-090019998be7 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1738 microversion: 2.20 time: 0.235121 Oct 28 19:11:36.519958 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 348/719] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:36 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:36.587943 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-76b8cdbc-227e-49e1-9c9e-d342c74068b0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/os-volume_attachments/5856a454-f918-4084-8635-e661ad162b63" status: 202 len: 0 microversion: 2.1 time: 0.247311 Oct 28 19:11:36.589349 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 372/720] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Oct 28 19:11:36 2022] DELETE /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/os-volume_attachments/5856a454-f918-4084-8635-e661ad162b63 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:11:36.603282 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-a571270d-caec-4a8e-96a5-2855dbd78da5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:36.605932 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-a571270d-caec-4a8e-96a5-2855dbd78da5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:36.619982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a571270d-caec-4a8e-96a5-2855dbd78da5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:36.621471 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a571270d-caec-4a8e-96a5-2855dbd78da5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:36.622174 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a571270d-caec-4a8e-96a5-2855dbd78da5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:36.623144 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a571270d-caec-4a8e-96a5-2855dbd78da5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:36.623812 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a571270d-caec-4a8e-96a5-2855dbd78da5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:36.624451 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a571270d-caec-4a8e-96a5-2855dbd78da5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:36.667449 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-a571270d-caec-4a8e-96a5-2855dbd78da5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073904 Oct 28 19:11:36.668263 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 349/721] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Oct 28 19:11:36 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:37.545789 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c0e942cc-eae4-46c1-b5f9-f660d1bc295e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:37.547404 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-c0e942cc-eae4-46c1-b5f9-f660d1bc295e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:37.554821 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c0e942cc-eae4-46c1-b5f9-f660d1bc295e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:37.555849 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c0e942cc-eae4-46c1-b5f9-f660d1bc295e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:37.556462 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c0e942cc-eae4-46c1-b5f9-f660d1bc295e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:37.557587 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c0e942cc-eae4-46c1-b5f9-f660d1bc295e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:37.558202 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c0e942cc-eae4-46c1-b5f9-f660d1bc295e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:37.558810 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c0e942cc-eae4-46c1-b5f9-f660d1bc295e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:37.568127 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-efaca982-e560-4503-bdea-219e5ee82e5a req-8a6929de-318b-41b3-934f-1838e50fe927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c2187f-f4f1-4d25-96ff-2b032986f8b1", "name": "network-vif-plugged", "status": "completed", "tag": "b53160b4-c25e-42f7-a698-ec959ecf8b6d"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:37.578475 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:37.581044 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-efaca982-e560-4503-bdea-219e5ee82e5a req-8a6929de-318b-41b3-934f-1838e50fe927 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:37.582377 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-efaca982-e560-4503-bdea-219e5ee82e5a req-8a6929de-318b-41b3-934f-1838e50fe927 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:37.583063 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-efaca982-e560-4503-bdea-219e5ee82e5a req-8a6929de-318b-41b3-934f-1838e50fe927 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:37.596705 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-efaca982-e560-4503-bdea-219e5ee82e5a req-8a6929de-318b-41b3-934f-1838e50fe927 service nova] Creating event network-vif-plugged:b53160b4-c25e-42f7-a698-ec959ecf8b6d for instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 on hv-cinder-86236 Oct 28 19:11:37.603997 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-efaca982-e560-4503-bdea-219e5ee82e5a req-8a6929de-318b-41b3-934f-1838e50fe927 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113607 Oct 28 19:11:37.605147 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 373/722] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:37.685291 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-731e24e4-0747-4c95-9f74-03294f498c39 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:37.690700 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-731e24e4-0747-4c95-9f74-03294f498c39 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:37.703667 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-731e24e4-0747-4c95-9f74-03294f498c39 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:37.705123 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-731e24e4-0747-4c95-9f74-03294f498c39 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:37.705808 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-731e24e4-0747-4c95-9f74-03294f498c39 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:37.706833 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-731e24e4-0747-4c95-9f74-03294f498c39 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:37.707471 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-731e24e4-0747-4c95-9f74-03294f498c39 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:37.708082 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-731e24e4-0747-4c95-9f74-03294f498c39 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:37.743568 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c0e942cc-eae4-46c1-b5f9-f660d1bc295e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:37.760053 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c0e942cc-eae4-46c1-b5f9-f660d1bc295e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:37.761747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c0e942cc-eae4-46c1-b5f9-f660d1bc295e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:37.765063 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-731e24e4-0747-4c95-9f74-03294f498c39 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087248 Oct 28 19:11:37.765621 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-c0e942cc-eae4-46c1-b5f9-f660d1bc295e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1738 microversion: 2.20 time: 0.222569 Oct 28 19:11:37.767714 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 350/723] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:37 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:37.779733 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 374/724] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Oct 28 19:11:37 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:11:38.786129 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-34993f37-c400-4767-85bb-185843b24e6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:38.788841 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-34993f37-c400-4767-85bb-185843b24e6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:38.796056 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-45a7f9da-c2af-42e4-9137-af564b9c6510 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:38.796641 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-34993f37-c400-4767-85bb-185843b24e6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:38.797551 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-45a7f9da-c2af-42e4-9137-af564b9c6510 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:38.797682 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-34993f37-c400-4767-85bb-185843b24e6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:38.798473 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-34993f37-c400-4767-85bb-185843b24e6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:38.798955 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-34993f37-c400-4767-85bb-185843b24e6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:38.799463 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-34993f37-c400-4767-85bb-185843b24e6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:38.799904 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-34993f37-c400-4767-85bb-185843b24e6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:38.819651 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-45a7f9da-c2af-42e4-9137-af564b9c6510 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:38.820189 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-45a7f9da-c2af-42e4-9137-af564b9c6510 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:38.820633 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-45a7f9da-c2af-42e4-9137-af564b9c6510 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:38.821362 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-45a7f9da-c2af-42e4-9137-af564b9c6510 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:38.821816 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-45a7f9da-c2af-42e4-9137-af564b9c6510 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:38.822239 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-45a7f9da-c2af-42e4-9137-af564b9c6510 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:38.833839 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-34993f37-c400-4767-85bb-185843b24e6a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052461 Oct 28 19:11:38.840432 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 351/725] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Oct 28 19:11:38 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:11:38.930683 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-f27875d6-5019-45a0-b9b8-d254e94f7ee1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:38.931377 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-f27875d6-5019-45a0-b9b8-d254e94f7ee1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:38.942566 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f27875d6-5019-45a0-b9b8-d254e94f7ee1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:38.943552 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f27875d6-5019-45a0-b9b8-d254e94f7ee1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:38.944684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f27875d6-5019-45a0-b9b8-d254e94f7ee1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:38.946936 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f27875d6-5019-45a0-b9b8-d254e94f7ee1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:38.950355 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f27875d6-5019-45a0-b9b8-d254e94f7ee1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:38.951069 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f27875d6-5019-45a0-b9b8-d254e94f7ee1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:38.986175 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-f27875d6-5019-45a0-b9b8-d254e94f7ee1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Going to try to terminate instance {{(pid=118875) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:11:38.993012 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-45a7f9da-c2af-42e4-9137-af564b9c6510 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:39.002530 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-45a7f9da-c2af-42e4-9137-af564b9c6510 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:39.004063 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-45a7f9da-c2af-42e4-9137-af564b9c6510 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:39.005288 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-45a7f9da-c2af-42e4-9137-af564b9c6510 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1738 microversion: 2.20 time: 0.213554 Oct 28 19:11:39.006063 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 375/726] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:38 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:39.024461 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:39.076160 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-f27875d6-5019-45a0-b9b8-d254e94f7ee1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 204 len: 0 microversion: 2.1 time: 0.150216 Oct 28 19:11:39.077100 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 352/727] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Oct 28 19:11:38 2022] DELETE /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:11:39.085032 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-5b791759-35df-454c-89e8-67b345e3560a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:39.086037 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-5b791759-35df-454c-89e8-67b345e3560a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:39.095670 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5b791759-35df-454c-89e8-67b345e3560a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:39.096444 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5b791759-35df-454c-89e8-67b345e3560a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:39.096877 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5b791759-35df-454c-89e8-67b345e3560a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:39.097582 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5b791759-35df-454c-89e8-67b345e3560a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:39.098032 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5b791759-35df-454c-89e8-67b345e3560a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:39.098458 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5b791759-35df-454c-89e8-67b345e3560a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:39.254023 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-5b791759-35df-454c-89e8-67b345e3560a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:39.262929 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-5b791759-35df-454c-89e8-67b345e3560a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1691 microversion: 2.1 time: 0.181864 Oct 28 19:11:39.279852 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 376/728] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:39 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:40.031503 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-8ca39251-2e90-4684-b5af-f4e2aec8f786 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:40.032377 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-8ca39251-2e90-4684-b5af-f4e2aec8f786 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:40.040328 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8ca39251-2e90-4684-b5af-f4e2aec8f786 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:40.041159 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8ca39251-2e90-4684-b5af-f4e2aec8f786 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:40.041684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8ca39251-2e90-4684-b5af-f4e2aec8f786 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:40.042469 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8ca39251-2e90-4684-b5af-f4e2aec8f786 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:40.042939 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8ca39251-2e90-4684-b5af-f4e2aec8f786 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:40.043392 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8ca39251-2e90-4684-b5af-f4e2aec8f786 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:40.286816 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-89cd28e9-fa95-42ac-a18a-d7a3773501eb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:40.288252 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-89cd28e9-fa95-42ac-a18a-d7a3773501eb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:40.296213 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-89cd28e9-fa95-42ac-a18a-d7a3773501eb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:40.296793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-89cd28e9-fa95-42ac-a18a-d7a3773501eb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:40.297297 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-89cd28e9-fa95-42ac-a18a-d7a3773501eb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:40.298924 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-89cd28e9-fa95-42ac-a18a-d7a3773501eb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:40.299633 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-89cd28e9-fa95-42ac-a18a-d7a3773501eb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:40.300280 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-89cd28e9-fa95-42ac-a18a-d7a3773501eb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:40.361001 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-8ca39251-2e90-4684-b5af-f4e2aec8f786 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:40.371351 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-8ca39251-2e90-4684-b5af-f4e2aec8f786 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:40.373345 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-8ca39251-2e90-4684-b5af-f4e2aec8f786 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:40.374855 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-8ca39251-2e90-4684-b5af-f4e2aec8f786 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1738 microversion: 2.20 time: 0.347550 Oct 28 19:11:40.375526 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 353/729] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:40 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1738 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:40.465665 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-89cd28e9-fa95-42ac-a18a-d7a3773501eb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:40.474968 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-89cd28e9-fa95-42ac-a18a-d7a3773501eb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1691 microversion: 2.1 time: 0.191970 Oct 28 19:11:40.475578 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 377/730] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:40 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1691 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:41.401645 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b2a6336a-7107-4c68-a494-10831bfa7ccc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:41.402348 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b2a6336a-7107-4c68-a494-10831bfa7ccc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:41.409796 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b2a6336a-7107-4c68-a494-10831bfa7ccc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.410281 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b2a6336a-7107-4c68-a494-10831bfa7ccc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.411180 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b2a6336a-7107-4c68-a494-10831bfa7ccc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.412124 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b2a6336a-7107-4c68-a494-10831bfa7ccc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.412774 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b2a6336a-7107-4c68-a494-10831bfa7ccc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.413398 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b2a6336a-7107-4c68-a494-10831bfa7ccc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.501881 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-c2e90d9b-a6bb-4057-b1ed-360f7c604d7c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:41.502630 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-c2e90d9b-a6bb-4057-b1ed-360f7c604d7c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:41.510474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c2e90d9b-a6bb-4057-b1ed-360f7c604d7c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.511476 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c2e90d9b-a6bb-4057-b1ed-360f7c604d7c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.512117 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c2e90d9b-a6bb-4057-b1ed-360f7c604d7c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.513150 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c2e90d9b-a6bb-4057-b1ed-360f7c604d7c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.513937 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c2e90d9b-a6bb-4057-b1ed-360f7c604d7c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.514580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-c2e90d9b-a6bb-4057-b1ed-360f7c604d7c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.569999 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b2a6336a-7107-4c68-a494-10831bfa7ccc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:41.580260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b2a6336a-7107-4c68-a494-10831bfa7ccc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:41.581740 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b2a6336a-7107-4c68-a494-10831bfa7ccc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:41.583186 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b2a6336a-7107-4c68-a494-10831bfa7ccc tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1738 microversion: 2.20 time: 0.185411 Oct 28 19:11:41.584001 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 354/731] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:41 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:41.662926 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-c2e90d9b-a6bb-4057-b1ed-360f7c604d7c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:41.671232 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-c2e90d9b-a6bb-4057-b1ed-360f7c604d7c tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1691 microversion: 2.1 time: 0.174118 Oct 28 19:11:41.671823 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 378/732] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:41 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:42.608401 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b0476d9a-a310-414c-ac23-ca24737fd0a1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:42.609840 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b0476d9a-a310-414c-ac23-ca24737fd0a1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:42.619573 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b0476d9a-a310-414c-ac23-ca24737fd0a1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.620462 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b0476d9a-a310-414c-ac23-ca24737fd0a1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.621147 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b0476d9a-a310-414c-ac23-ca24737fd0a1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.622100 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b0476d9a-a310-414c-ac23-ca24737fd0a1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.622750 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b0476d9a-a310-414c-ac23-ca24737fd0a1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.623363 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b0476d9a-a310-414c-ac23-ca24737fd0a1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.695770 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4f05d2f9-ffb2-4bd9-bd54-dec0be22bf1a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:42.696979 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-4f05d2f9-ffb2-4bd9-bd54-dec0be22bf1a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:42.703655 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4f05d2f9-ffb2-4bd9-bd54-dec0be22bf1a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.704482 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4f05d2f9-ffb2-4bd9-bd54-dec0be22bf1a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.705114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4f05d2f9-ffb2-4bd9-bd54-dec0be22bf1a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.706042 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4f05d2f9-ffb2-4bd9-bd54-dec0be22bf1a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.707218 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4f05d2f9-ffb2-4bd9-bd54-dec0be22bf1a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.707883 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4f05d2f9-ffb2-4bd9-bd54-dec0be22bf1a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.712552 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:42.849997 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b0476d9a-a310-414c-ac23-ca24737fd0a1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:42.858506 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b0476d9a-a310-414c-ac23-ca24737fd0a1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:42.860044 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b0476d9a-a310-414c-ac23-ca24737fd0a1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:42.861257 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b0476d9a-a310-414c-ac23-ca24737fd0a1 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1738 microversion: 2.20 time: 0.256843 Oct 28 19:11:42.861806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 355/733] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:42 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1738 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:42.906763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4f05d2f9-ffb2-4bd9-bd54-dec0be22bf1a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:42.917221 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-4f05d2f9-ffb2-4bd9-bd54-dec0be22bf1a tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1691 microversion: 2.1 time: 0.225297 Oct 28 19:11:42.918097 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 379/734] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:42 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1691 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:43.890506 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d4a2a580-fc43-48ab-8413-5264c54ad288 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:43.892103 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d4a2a580-fc43-48ab-8413-5264c54ad288 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:43.912012 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d4a2a580-fc43-48ab-8413-5264c54ad288 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:43.918681 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-9f67d481-7641-4aca-852e-61d39e1ee894 req-074932ea-0cfc-43ab-a850-fbb7c2c63e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f", "name": "network-vif-deleted", "tag": "92395a5b-edfc-4644-8dc9-9103854d9dac"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:43.926724 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d4a2a580-fc43-48ab-8413-5264c54ad288 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:43.931803 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d4a2a580-fc43-48ab-8413-5264c54ad288 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:43.932731 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d4a2a580-fc43-48ab-8413-5264c54ad288 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:43.933226 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d4a2a580-fc43-48ab-8413-5264c54ad288 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:43.933669 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d4a2a580-fc43-48ab-8413-5264c54ad288 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:43.958801 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-9f67d481-7641-4aca-852e-61d39e1ee894 req-074932ea-0cfc-43ab-a850-fbb7c2c63e1c service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:43.959578 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-9f67d481-7641-4aca-852e-61d39e1ee894 req-074932ea-0cfc-43ab-a850-fbb7c2c63e1c service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:43.963755 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-9f67d481-7641-4aca-852e-61d39e1ee894 req-074932ea-0cfc-43ab-a850-fbb7c2c63e1c service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:43.992065 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-9f67d481-7641-4aca-852e-61d39e1ee894 req-074932ea-0cfc-43ab-a850-fbb7c2c63e1c service nova] Creating event network-vif-deleted:92395a5b-edfc-4644-8dc9-9103854d9dac for instance 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f on hv-cinder-86236 Oct 28 19:11:44.017885 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-9f67d481-7641-4aca-852e-61d39e1ee894 req-074932ea-0cfc-43ab-a850-fbb7c2c63e1c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102322 Oct 28 19:11:44.023877 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 380/735] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:44.059064 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-63e157ff-7536-465f-aaf6-20dc4ead676d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:44.064227 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-63e157ff-7536-465f-aaf6-20dc4ead676d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:44.089456 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-63e157ff-7536-465f-aaf6-20dc4ead676d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:44.089963 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-63e157ff-7536-465f-aaf6-20dc4ead676d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:44.090412 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-63e157ff-7536-465f-aaf6-20dc4ead676d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:44.091209 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-63e157ff-7536-465f-aaf6-20dc4ead676d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:44.091677 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-63e157ff-7536-465f-aaf6-20dc4ead676d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:44.092109 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-63e157ff-7536-465f-aaf6-20dc4ead676d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:44.194197 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-63e157ff-7536-465f-aaf6-20dc4ead676d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:44.195321 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-63e157ff-7536-465f-aaf6-20dc4ead676d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:44.195940 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-63e157ff-7536-465f-aaf6-20dc4ead676d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:44.196585 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.objects.instance [None req-63e157ff-7536-465f-aaf6-20dc4ead676d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lazy-loading 'fault' on Instance uuid 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f {{(pid=118874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:44.567341 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-63e157ff-7536-465f-aaf6-20dc4ead676d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:44.580017 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-63e157ff-7536-465f-aaf6-20dc4ead676d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 200 len: 1336 microversion: 2.1 time: 0.553982 Oct 28 19:11:44.580986 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 381/736] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:44 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 1336 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:44.592625 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d4a2a580-fc43-48ab-8413-5264c54ad288 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:44.601873 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d4a2a580-fc43-48ab-8413-5264c54ad288 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:44.606746 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d4a2a580-fc43-48ab-8413-5264c54ad288 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:44.608282 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d4a2a580-fc43-48ab-8413-5264c54ad288 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1738 microversion: 2.20 time: 0.722013 Oct 28 19:11:44.609150 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 356/737] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:43 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1738 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:45.607279 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-899656d1-c9eb-449d-a347-51dcb8ff59cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:45.608008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-899656d1-c9eb-449d-a347-51dcb8ff59cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:45.613842 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-899656d1-c9eb-449d-a347-51dcb8ff59cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:45.614391 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-899656d1-c9eb-449d-a347-51dcb8ff59cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:45.614900 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-899656d1-c9eb-449d-a347-51dcb8ff59cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:45.615741 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-899656d1-c9eb-449d-a347-51dcb8ff59cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:45.616302 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-899656d1-c9eb-449d-a347-51dcb8ff59cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:45.616950 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-899656d1-c9eb-449d-a347-51dcb8ff59cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:45.632849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-899656d1-c9eb-449d-a347-51dcb8ff59cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] HTTP exception thrown: Instance 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f could not be found. Oct 28 19:11:45.633896 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-efd10394-a7b4-4bc6-8c0f-e7a630443555 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:45.634683 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-efd10394-a7b4-4bc6-8c0f-e7a630443555 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-899656d1-c9eb-449d-a347-51dcb8ff59cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Request method failure captured: Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f HTTP/1.1 Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCglU6keeyc9TPFu8kh2CtSTL27mYzieTeXTMg3qjeLwWS58Om5L1-wzv5iwcJqqpWrZlbacG63VxxUqEcwRqSRGut_CvjvYM0Iq9ARpxZRlx9JGTssQ2QQL0BA1xD17zsswm8pySHHhA5LPoDCKLfH2eOnw8zYt795C9xWjuK8UoFU Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: 4f6c133d9594455182ac1b9ce13df65c Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-136875089 Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:11:45.634813 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:11:45.636412 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:11:45.636412 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-ServerRescueNegativeTestJSON-136875089 Oct 28 19:11:45.636412 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: 4f6c133d9594455182ac1b9ce13df65c Oct 28 19:11:45.636412 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-136875089 Oct 28 19:11:45.636412 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-ServerRescueNegativeTestJSON-136875089-project Oct 28 19:11:45.636412 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:11:45.636412 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:11:45.636412 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: c8ca34fc5c5743d0b5e3f4f97ae285e0 Oct 28 19:11:45.636412 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-ServerRescueNegativeTestJSON-136875089-project Oct 28 19:11:45.636412 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: > Oct 28 19:11:45.636412 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Instance 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f could not be found. Oct 28 19:11:45.636412 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'id': '9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f'} Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f could not be found. Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:45.637373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:45.638849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:45.638849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:11:45.638849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:11:45.638849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:11:45.638849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:11:45.638849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:11:45.638849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:11:45.638849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f could not be found. Oct 28 19:11:45.638849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:11:45.638849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:45.638849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:11:45.638849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:45.638849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:45.638849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:45.638849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:11:45.638849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:11:45.638849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f could not be found. Oct 28 19:11:45.638849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:11:45.640632 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-899656d1-c9eb-449d-a347-51dcb8ff59cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Returning 404 to user: Instance 9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f could not be found. {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:45.640632 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-899656d1-c9eb-449d-a347-51dcb8ff59cc tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f" status: 404 len: 111 microversion: 2.1 time: 0.032675 Oct 28 19:11:45.640632 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 382/738] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:45 2022] GET /compute/v2.1/servers/9e4ce80a-9fa5-4144-98d9-8bd262cf6c7f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:11:45.641097 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-efd10394-a7b4-4bc6-8c0f-e7a630443555 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:45.642267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-efd10394-a7b4-4bc6-8c0f-e7a630443555 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:45.642742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-efd10394-a7b4-4bc6-8c0f-e7a630443555 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:45.643567 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-efd10394-a7b4-4bc6-8c0f-e7a630443555 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:45.644021 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-efd10394-a7b4-4bc6-8c0f-e7a630443555 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:45.644450 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-efd10394-a7b4-4bc6-8c0f-e7a630443555 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:45.647855 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-09198908-38f7-4743-8a59-ae1dfde9b6c0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '.version_select at 0x7f9bf680b4c0>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:45.671465 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-09198908-38f7-4743-8a59-ae1dfde9b6c0 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906400234" status: 202 len: 0 microversion: 2.1 time: 0.027210 Oct 28 19:11:45.672033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 383/739] 10.222.0.58 () {58 vars in 1221 bytes} [Fri Oct 28 19:11:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906400234 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:11:45.843756 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-efd10394-a7b4-4bc6-8c0f-e7a630443555 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:45.852205 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-efd10394-a7b4-4bc6-8c0f-e7a630443555 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:45.853738 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-efd10394-a7b4-4bc6-8c0f-e7a630443555 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:45.855006 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-efd10394-a7b4-4bc6-8c0f-e7a630443555 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1738 microversion: 2.20 time: 0.225294 Oct 28 19:11:45.855579 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 357/740] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:45 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:11:46.883377 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-e1d51417-f7dd-4a6c-87eb-b13532dbcde0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:46.884248 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-e1d51417-f7dd-4a6c-87eb-b13532dbcde0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:46.890876 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e1d51417-f7dd-4a6c-87eb-b13532dbcde0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:46.891445 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e1d51417-f7dd-4a6c-87eb-b13532dbcde0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:46.891932 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e1d51417-f7dd-4a6c-87eb-b13532dbcde0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:46.892618 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e1d51417-f7dd-4a6c-87eb-b13532dbcde0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:46.893067 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e1d51417-f7dd-4a6c-87eb-b13532dbcde0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:46.893488 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e1d51417-f7dd-4a6c-87eb-b13532dbcde0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:47.021219 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e1d51417-f7dd-4a6c-87eb-b13532dbcde0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:47.029274 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e1d51417-f7dd-4a6c-87eb-b13532dbcde0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:47.030714 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e1d51417-f7dd-4a6c-87eb-b13532dbcde0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:47.031901 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-e1d51417-f7dd-4a6c-87eb-b13532dbcde0 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1720 microversion: 2.20 time: 0.152703 Oct 28 19:11:47.032488 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 384/741] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:46 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:48.057921 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d0aecbd6-4b28-4391-a89b-c48551dbd107 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:48.058524 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d0aecbd6-4b28-4391-a89b-c48551dbd107 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:48.065004 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d0aecbd6-4b28-4391-a89b-c48551dbd107 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:48.065483 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d0aecbd6-4b28-4391-a89b-c48551dbd107 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:48.065926 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d0aecbd6-4b28-4391-a89b-c48551dbd107 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:48.066618 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d0aecbd6-4b28-4391-a89b-c48551dbd107 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:48.067092 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d0aecbd6-4b28-4391-a89b-c48551dbd107 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:48.067518 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d0aecbd6-4b28-4391-a89b-c48551dbd107 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:48.195819 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d0aecbd6-4b28-4391-a89b-c48551dbd107 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:48.204219 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d0aecbd6-4b28-4391-a89b-c48551dbd107 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:48.205683 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d0aecbd6-4b28-4391-a89b-c48551dbd107 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:48.206853 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d0aecbd6-4b28-4391-a89b-c48551dbd107 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1720 microversion: 2.20 time: 0.152861 Oct 28 19:11:48.207449 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 358/742] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:48 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:48.647177 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f7f35fe4-45c7-444a-8404-46d5be42a0f5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:48.647699 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f7f35fe4-45c7-444a-8404-46d5be42a0f5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:48.653583 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7f35fe4-45c7-444a-8404-46d5be42a0f5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:48.654074 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7f35fe4-45c7-444a-8404-46d5be42a0f5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:48.654539 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7f35fe4-45c7-444a-8404-46d5be42a0f5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:48.655251 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7f35fe4-45c7-444a-8404-46d5be42a0f5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:48.655708 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7f35fe4-45c7-444a-8404-46d5be42a0f5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:48.656139 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7f35fe4-45c7-444a-8404-46d5be42a0f5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:48.682083 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f7f35fe4-45c7-444a-8404-46d5be42a0f5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Going to try to terminate instance {{(pid=118874) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:11:48.768855 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f7f35fe4-45c7-444a-8404-46d5be42a0f5 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "DELETE /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 204 len: 0 microversion: 2.1 time: 0.125040 Oct 28 19:11:48.769553 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 385/743] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Oct 28 19:11:48 2022] DELETE /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:11:48.778078 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-e7061b81-ea0d-419f-9c50-7fefc6a153ef tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:48.778836 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-e7061b81-ea0d-419f-9c50-7fefc6a153ef tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:48.785523 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e7061b81-ea0d-419f-9c50-7fefc6a153ef tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:48.786022 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e7061b81-ea0d-419f-9c50-7fefc6a153ef tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:48.786473 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e7061b81-ea0d-419f-9c50-7fefc6a153ef tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:48.787222 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e7061b81-ea0d-419f-9c50-7fefc6a153ef tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:48.787687 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e7061b81-ea0d-419f-9c50-7fefc6a153ef tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:48.788121 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-e7061b81-ea0d-419f-9c50-7fefc6a153ef tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:48.921551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-e7061b81-ea0d-419f-9c50-7fefc6a153ef tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:48.929310 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-e7061b81-ea0d-419f-9c50-7fefc6a153ef tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1508 microversion: 2.1 time: 0.155296 Oct 28 19:11:48.929892 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 359/744] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:48 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:49.233464 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-338baaca-7fae-48d6-b55b-a8467179a6de tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:49.234054 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-338baaca-7fae-48d6-b55b-a8467179a6de tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:49.240586 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-338baaca-7fae-48d6-b55b-a8467179a6de tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:49.241059 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-338baaca-7fae-48d6-b55b-a8467179a6de tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:49.241490 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-338baaca-7fae-48d6-b55b-a8467179a6de tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:49.242160 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-338baaca-7fae-48d6-b55b-a8467179a6de tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:49.242602 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-338baaca-7fae-48d6-b55b-a8467179a6de tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:49.243041 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-338baaca-7fae-48d6-b55b-a8467179a6de tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:49.377280 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-338baaca-7fae-48d6-b55b-a8467179a6de tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:49.386063 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-338baaca-7fae-48d6-b55b-a8467179a6de tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:49.387517 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-338baaca-7fae-48d6-b55b-a8467179a6de tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:49.388673 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-338baaca-7fae-48d6-b55b-a8467179a6de tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1723 microversion: 2.20 time: 0.159611 Oct 28 19:11:49.389232 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 386/745] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:49 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:49.397611 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-8cb4d246-8d5d-441c-8c3b-88e4d9de4c27 req-d467823a-be32-427f-87c7-24a05a908b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c2187f-f4f1-4d25-96ff-2b032986f8b1", "name": "network-vif-unplugged", "status": "completed", "tag": "b53160b4-c25e-42f7-a698-ec959ecf8b6d"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:49.408712 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-8cb4d246-8d5d-441c-8c3b-88e4d9de4c27 req-d467823a-be32-427f-87c7-24a05a908b94 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:49.409460 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-8cb4d246-8d5d-441c-8c3b-88e4d9de4c27 req-d467823a-be32-427f-87c7-24a05a908b94 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:49.409900 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-8cb4d246-8d5d-441c-8c3b-88e4d9de4c27 req-d467823a-be32-427f-87c7-24a05a908b94 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:49.413911 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-ec562eb9-8aba-4c8d-913a-7fb12cefaec4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a57a7d2-f104-4b0e-bb7e-c99b14fe2763"}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:49.416248 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-ec562eb9-8aba-4c8d-913a-7fb12cefaec4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:49.421991 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-8cb4d246-8d5d-441c-8c3b-88e4d9de4c27 req-d467823a-be32-427f-87c7-24a05a908b94 service nova] Creating event network-vif-unplugged:b53160b4-c25e-42f7-a698-ec959ecf8b6d for instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 on hv-cinder-86236 Oct 28 19:11:49.422167 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ec562eb9-8aba-4c8d-913a-7fb12cefaec4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:49.423237 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ec562eb9-8aba-4c8d-913a-7fb12cefaec4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:49.423697 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ec562eb9-8aba-4c8d-913a-7fb12cefaec4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:49.424396 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ec562eb9-8aba-4c8d-913a-7fb12cefaec4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:49.424834 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ec562eb9-8aba-4c8d-913a-7fb12cefaec4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:49.425258 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ec562eb9-8aba-4c8d-913a-7fb12cefaec4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:49.427787 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-8cb4d246-8d5d-441c-8c3b-88e4d9de4c27 req-d467823a-be32-427f-87c7-24a05a908b94 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033706 Oct 28 19:11:49.428367 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 360/746] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:49.692457 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-ec562eb9-8aba-4c8d-913a-7fb12cefaec4 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "POST /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.282515 Oct 28 19:11:49.693064 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 387/747] 10.222.0.58 () {62 vars in 1364 bytes} [Fri Oct 28 19:11:49 2022] POST /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1/os-volume_attachments => generated 188 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:11:49.953607 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-20a25d89-0770-4968-92a5-799018851f34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:49.954871 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-20a25d89-0770-4968-92a5-799018851f34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:49.960974 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-20a25d89-0770-4968-92a5-799018851f34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:49.961455 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-20a25d89-0770-4968-92a5-799018851f34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:49.961895 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-20a25d89-0770-4968-92a5-799018851f34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:49.962604 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-20a25d89-0770-4968-92a5-799018851f34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:49.963071 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-20a25d89-0770-4968-92a5-799018851f34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:49.963503 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-20a25d89-0770-4968-92a5-799018851f34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:49.968464 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-2f91bc6d-61df-46a2-99cf-d9be916327be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:49.968961 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-2f91bc6d-61df-46a2-99cf-d9be916327be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:49.975435 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2f91bc6d-61df-46a2-99cf-d9be916327be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:49.975909 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2f91bc6d-61df-46a2-99cf-d9be916327be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:49.976342 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2f91bc6d-61df-46a2-99cf-d9be916327be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:49.977025 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2f91bc6d-61df-46a2-99cf-d9be916327be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:49.977475 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2f91bc6d-61df-46a2-99cf-d9be916327be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:49.977898 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2f91bc6d-61df-46a2-99cf-d9be916327be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:50.101470 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-20a25d89-0770-4968-92a5-799018851f34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:50.109387 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-20a25d89-0770-4968-92a5-799018851f34 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1508 microversion: 2.1 time: 0.159895 Oct 28 19:11:50.110701 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 361/748] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:49 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:50.216795 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-2f91bc6d-61df-46a2-99cf-d9be916327be tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "DELETE /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1/os-volume_attachments/8a57a7d2-f104-4b0e-bb7e-c99b14fe2763" status: 202 len: 0 microversion: 2.20 time: 0.252248 Oct 28 19:11:50.217385 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 388/749] 10.222.0.58 () {60 vars in 1457 bytes} [Fri Oct 28 19:11:49 2022] DELETE /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1/os-volume_attachments/8a57a7d2-f104-4b0e-bb7e-c99b14fe2763 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:11:50.278031 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-7af92153-d356-419e-8630-30f78a4cc794 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:50.278615 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-7af92153-d356-419e-8630-30f78a4cc794 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:50.285042 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7af92153-d356-419e-8630-30f78a4cc794 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:50.285521 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7af92153-d356-419e-8630-30f78a4cc794 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:50.285954 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7af92153-d356-419e-8630-30f78a4cc794 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:50.286643 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7af92153-d356-419e-8630-30f78a4cc794 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:50.287120 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7af92153-d356-419e-8630-30f78a4cc794 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:50.287548 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7af92153-d356-419e-8630-30f78a4cc794 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:50.329420 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-7af92153-d356-419e-8630-30f78a4cc794 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118875) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 19:11:50.397535 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-7af92153-d356-419e-8630-30f78a4cc794 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "POST /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1/action" status: 202 len: 0 microversion: 2.20 time: 0.123435 Oct 28 19:11:50.401037 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 362/750] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Oct 28 19:11:50 2022] POST /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:11:50.406096 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-27a1555a-94f6-446b-9195-bab3b4559ce6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:50.407556 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-27a1555a-94f6-446b-9195-bab3b4559ce6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:50.413542 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-27a1555a-94f6-446b-9195-bab3b4559ce6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:50.414023 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-27a1555a-94f6-446b-9195-bab3b4559ce6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:50.414459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-27a1555a-94f6-446b-9195-bab3b4559ce6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:50.415724 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-27a1555a-94f6-446b-9195-bab3b4559ce6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:50.415724 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-27a1555a-94f6-446b-9195-bab3b4559ce6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:50.416042 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-27a1555a-94f6-446b-9195-bab3b4559ce6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:50.552584 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-27a1555a-94f6-446b-9195-bab3b4559ce6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:50.562590 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-27a1555a-94f6-446b-9195-bab3b4559ce6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:50.564317 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-27a1555a-94f6-446b-9195-bab3b4559ce6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:50.565575 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-27a1555a-94f6-446b-9195-bab3b4559ce6 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1731 microversion: 2.20 time: 0.163352 Oct 28 19:11:50.566239 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 389/751] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:50 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:51.133498 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-5d00ff44-18e0-4dee-9b3d-fa6d098d442d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:51.135048 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-5d00ff44-18e0-4dee-9b3d-fa6d098d442d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:51.144653 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5d00ff44-18e0-4dee-9b3d-fa6d098d442d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.145827 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5d00ff44-18e0-4dee-9b3d-fa6d098d442d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.146316 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5d00ff44-18e0-4dee-9b3d-fa6d098d442d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:51.147135 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5d00ff44-18e0-4dee-9b3d-fa6d098d442d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.147594 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5d00ff44-18e0-4dee-9b3d-fa6d098d442d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.148182 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5d00ff44-18e0-4dee-9b3d-fa6d098d442d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:51.298070 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-5d00ff44-18e0-4dee-9b3d-fa6d098d442d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:51.307615 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-5d00ff44-18e0-4dee-9b3d-fa6d098d442d tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1508 microversion: 2.1 time: 0.178505 Oct 28 19:11:51.308478 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 363/752] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:51 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:51.557430 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-da60c5f6-3986-4fc6-acc0-5d5682c16e07 req-afd04632-5528-4c5b-be35-d630e398b1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48109dc7-b13e-4e6f-ad81-fd2e296fce62", "name": "network-vif-deleted", "tag": "ef2ab85a-6668-4509-8eda-8a1c2af741e2"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:51.576987 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-da60c5f6-3986-4fc6-acc0-5d5682c16e07 req-afd04632-5528-4c5b-be35-d630e398b1e9 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.577396 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-da60c5f6-3986-4fc6-acc0-5d5682c16e07 req-afd04632-5528-4c5b-be35-d630e398b1e9 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.578332 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-da60c5f6-3986-4fc6-acc0-5d5682c16e07 req-afd04632-5528-4c5b-be35-d630e398b1e9 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:51.592049 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-a918dc6e-0f92-4ec6-99e1-f4a3b38c5908 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:51.592750 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-a918dc6e-0f92-4ec6-99e1-f4a3b38c5908 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:51.595617 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-da60c5f6-3986-4fc6-acc0-5d5682c16e07 req-afd04632-5528-4c5b-be35-d630e398b1e9 service nova] Creating event network-vif-deleted:ef2ab85a-6668-4509-8eda-8a1c2af741e2 for instance 48109dc7-b13e-4e6f-ad81-fd2e296fce62 on hv-cinder-86236 Oct 28 19:11:51.599927 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a918dc6e-0f92-4ec6-99e1-f4a3b38c5908 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.600837 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a918dc6e-0f92-4ec6-99e1-f4a3b38c5908 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.601767 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a918dc6e-0f92-4ec6-99e1-f4a3b38c5908 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:51.602817 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a918dc6e-0f92-4ec6-99e1-f4a3b38c5908 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.603494 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a918dc6e-0f92-4ec6-99e1-f4a3b38c5908 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.603823 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-da60c5f6-3986-4fc6-acc0-5d5682c16e07 req-afd04632-5528-4c5b-be35-d630e398b1e9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050404 Oct 28 19:11:51.604375 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a918dc6e-0f92-4ec6-99e1-f4a3b38c5908 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:51.604882 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 390/753] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:51.748277 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a918dc6e-0f92-4ec6-99e1-f4a3b38c5908 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:51.757415 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a918dc6e-0f92-4ec6-99e1-f4a3b38c5908 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:51.759344 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a918dc6e-0f92-4ec6-99e1-f4a3b38c5908 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:51.760778 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-a918dc6e-0f92-4ec6-99e1-f4a3b38c5908 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1729 microversion: 2.20 time: 0.173080 Oct 28 19:11:51.761334 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 364/754] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:51 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:52.330826 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-72800434-dfe3-4d25-b087-dba022423fe6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:52.331554 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-72800434-dfe3-4d25-b087-dba022423fe6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:52.337985 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-72800434-dfe3-4d25-b087-dba022423fe6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:52.338463 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-72800434-dfe3-4d25-b087-dba022423fe6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:52.338894 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-72800434-dfe3-4d25-b087-dba022423fe6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:52.339633 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-72800434-dfe3-4d25-b087-dba022423fe6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:52.340082 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-72800434-dfe3-4d25-b087-dba022423fe6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:52.340499 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-72800434-dfe3-4d25-b087-dba022423fe6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:52.375075 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-72800434-dfe3-4d25-b087-dba022423fe6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:52.375651 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-72800434-dfe3-4d25-b087-dba022423fe6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:52.376189 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-72800434-dfe3-4d25-b087-dba022423fe6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:52.376747 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.objects.instance [None req-72800434-dfe3-4d25-b087-dba022423fe6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lazy-loading 'fault' on Instance uuid 48109dc7-b13e-4e6f-ad81-fd2e296fce62 {{(pid=118874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:52.379770 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=9,nova_cell1:INSERT=6 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:52.420133 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-72800434-dfe3-4d25-b087-dba022423fe6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:52.428418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-72800434-dfe3-4d25-b087-dba022423fe6 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 200 len: 1312 microversion: 2.1 time: 0.101793 Oct 28 19:11:52.428982 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 391/755] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:52 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:52.787374 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-a7148b3e-89da-4fb6-abe8-3e6fc13e094f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:52.787986 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-a7148b3e-89da-4fb6-abe8-3e6fc13e094f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:52.794758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a7148b3e-89da-4fb6-abe8-3e6fc13e094f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:52.795508 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a7148b3e-89da-4fb6-abe8-3e6fc13e094f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:52.796146 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a7148b3e-89da-4fb6-abe8-3e6fc13e094f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:52.797052 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a7148b3e-89da-4fb6-abe8-3e6fc13e094f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:52.797597 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a7148b3e-89da-4fb6-abe8-3e6fc13e094f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:52.798248 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a7148b3e-89da-4fb6-abe8-3e6fc13e094f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:52.945568 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a7148b3e-89da-4fb6-abe8-3e6fc13e094f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:52.956795 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a7148b3e-89da-4fb6-abe8-3e6fc13e094f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:52.958626 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a7148b3e-89da-4fb6-abe8-3e6fc13e094f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:52.960061 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-a7148b3e-89da-4fb6-abe8-3e6fc13e094f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1729 microversion: 2.20 time: 0.176714 Oct 28 19:11:52.960622 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 365/756] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:52 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:53.451435 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-035c8636-27cb-4bb1-936e-55ff3875c874 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:53.452265 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-035c8636-27cb-4bb1-936e-55ff3875c874 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 48109dc7-b13e-4e6f-ad81-fd2e296fce62] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:53.470396 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-035c8636-27cb-4bb1-936e-55ff3875c874 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.470894 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-035c8636-27cb-4bb1-936e-55ff3875c874 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.471547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-035c8636-27cb-4bb1-936e-55ff3875c874 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.472462 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-035c8636-27cb-4bb1-936e-55ff3875c874 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.473072 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-035c8636-27cb-4bb1-936e-55ff3875c874 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.473669 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-035c8636-27cb-4bb1-936e-55ff3875c874 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.488932 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-035c8636-27cb-4bb1-936e-55ff3875c874 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] HTTP exception thrown: Instance 48109dc7-b13e-4e6f-ad81-fd2e296fce62 could not be found. Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-035c8636-27cb-4bb1-936e-55ff3875c874 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Request method failure captured: Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 HTTP/1.1 Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCglU6keeyc9TPFu8kh2CtSTL27mYzieTeXTMg3qjeLwWS58Om5L1-wzv5iwcJqqpWrZlbacG63VxxUqEcwRqSRGut_CvjvYM0Iq9ARpxZRlx9JGTssQ2QQL0BA1xD17zsswm8pySHHhA5LPoDCKLfH2eOnw8zYt795C9xWjuK8UoFU Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: 4f6c133d9594455182ac1b9ce13df65c Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-136875089 Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:11:53.490856 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:11:53.492360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:11:53.492360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-ServerRescueNegativeTestJSON-136875089 Oct 28 19:11:53.492360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: 4f6c133d9594455182ac1b9ce13df65c Oct 28 19:11:53.492360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-136875089 Oct 28 19:11:53.492360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-ServerRescueNegativeTestJSON-136875089-project Oct 28 19:11:53.492360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:11:53.492360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:11:53.492360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: c8ca34fc5c5743d0b5e3f4f97ae285e0 Oct 28 19:11:53.492360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-ServerRescueNegativeTestJSON-136875089-project Oct 28 19:11:53.492360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: > Oct 28 19:11:53.492360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Instance 48109dc7-b13e-4e6f-ad81-fd2e296fce62 could not be found. Oct 28 19:11:53.492360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'id': '48109dc7-b13e-4e6f-ad81-fd2e296fce62'} Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48109dc7-b13e-4e6f-ad81-fd2e296fce62 could not be found. Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:53.493157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:53.494830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:53.494830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:11:53.494830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:11:53.494830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:11:53.494830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:11:53.494830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:11:53.494830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:11:53.494830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48109dc7-b13e-4e6f-ad81-fd2e296fce62 could not be found. Oct 28 19:11:53.494830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:11:53.494830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:53.494830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:11:53.494830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:53.494830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:53.494830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:53.494830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:11:53.494830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:11:53.494830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48109dc7-b13e-4e6f-ad81-fd2e296fce62 could not be found. Oct 28 19:11:53.494830 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:11:53.497888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-035c8636-27cb-4bb1-936e-55ff3875c874 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Returning 404 to user: Instance 48109dc7-b13e-4e6f-ad81-fd2e296fce62 could not be found. {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:53.499008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-035c8636-27cb-4bb1-936e-55ff3875c874 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62" status: 404 len: 111 microversion: 2.1 time: 0.051616 Oct 28 19:11:53.503676 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 392/757] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:53 2022] GET /compute/v2.1/servers/48109dc7-b13e-4e6f-ad81-fd2e296fce62 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:11:53.511274 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-09c8e71a-1cef-47e5-b115-5fac418e725b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:53.512049 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-09c8e71a-1cef-47e5-b115-5fac418e725b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:53.524820 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-09c8e71a-1cef-47e5-b115-5fac418e725b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.525387 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-09c8e71a-1cef-47e5-b115-5fac418e725b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.525848 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-09c8e71a-1cef-47e5-b115-5fac418e725b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.526628 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-09c8e71a-1cef-47e5-b115-5fac418e725b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.527147 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-09c8e71a-1cef-47e5-b115-5fac418e725b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.527633 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-09c8e71a-1cef-47e5-b115-5fac418e725b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.574086 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-09c8e71a-1cef-47e5-b115-5fac418e725b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Going to try to terminate instance {{(pid=118875) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:11:53.651038 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:53.690724 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-09c8e71a-1cef-47e5-b115-5fac418e725b tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "DELETE /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 204 len: 0 microversion: 2.1 time: 0.185421 Oct 28 19:11:53.692232 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 366/758] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Oct 28 19:11:53 2022] DELETE /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:11:53.701713 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-e0c011b5-fa75-4d75-9919-2f766260843e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:53.703071 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-e0c011b5-fa75-4d75-9919-2f766260843e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:53.725156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e0c011b5-fa75-4d75-9919-2f766260843e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.725636 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e0c011b5-fa75-4d75-9919-2f766260843e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.726271 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e0c011b5-fa75-4d75-9919-2f766260843e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.728661 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e0c011b5-fa75-4d75-9919-2f766260843e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.729291 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e0c011b5-fa75-4d75-9919-2f766260843e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.732250 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e0c011b5-fa75-4d75-9919-2f766260843e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.900646 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e0c011b5-fa75-4d75-9919-2f766260843e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:53.909397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-e0c011b5-fa75-4d75-9919-2f766260843e tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.213024 Oct 28 19:11:53.923658 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 393/759] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:53 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:53.986206 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b886f783-9afc-4c06-be72-75bbfa944ba5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:53.986938 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b886f783-9afc-4c06-be72-75bbfa944ba5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:53.993375 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b886f783-9afc-4c06-be72-75bbfa944ba5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.994223 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b886f783-9afc-4c06-be72-75bbfa944ba5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.994886 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b886f783-9afc-4c06-be72-75bbfa944ba5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.995841 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b886f783-9afc-4c06-be72-75bbfa944ba5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.996379 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b886f783-9afc-4c06-be72-75bbfa944ba5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.996872 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b886f783-9afc-4c06-be72-75bbfa944ba5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:54.134965 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b886f783-9afc-4c06-be72-75bbfa944ba5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:54.146123 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b886f783-9afc-4c06-be72-75bbfa944ba5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:54.147785 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b886f783-9afc-4c06-be72-75bbfa944ba5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:54.148978 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b886f783-9afc-4c06-be72-75bbfa944ba5 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1729 microversion: 2.20 time: 0.167084 Oct 28 19:11:54.159013 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 367/760] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:53 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:54.934070 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a2c6952b-8728-4a6c-aa4a-c670ed58f4f8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:54.934797 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-a2c6952b-8728-4a6c-aa4a-c670ed58f4f8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:54.942162 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a2c6952b-8728-4a6c-aa4a-c670ed58f4f8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:54.942914 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a2c6952b-8728-4a6c-aa4a-c670ed58f4f8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:54.943380 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a2c6952b-8728-4a6c-aa4a-c670ed58f4f8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:54.944082 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a2c6952b-8728-4a6c-aa4a-c670ed58f4f8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:54.944532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a2c6952b-8728-4a6c-aa4a-c670ed58f4f8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:54.944958 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a2c6952b-8728-4a6c-aa4a-c670ed58f4f8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.090154 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-a2c6952b-8728-4a6c-aa4a-c670ed58f4f8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:55.098462 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-a2c6952b-8728-4a6c-aa4a-c670ed58f4f8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.168270 Oct 28 19:11:55.099055 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 394/761] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:54 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:55.175931 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-3fc75f0b-9da3-455a-8942-73f182d46e75 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:55.177404 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-3fc75f0b-9da3-455a-8942-73f182d46e75 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:55.184493 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3fc75f0b-9da3-455a-8942-73f182d46e75 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.185339 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3fc75f0b-9da3-455a-8942-73f182d46e75 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.185849 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3fc75f0b-9da3-455a-8942-73f182d46e75 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.186583 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3fc75f0b-9da3-455a-8942-73f182d46e75 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.187093 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3fc75f0b-9da3-455a-8942-73f182d46e75 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.187524 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-3fc75f0b-9da3-455a-8942-73f182d46e75 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.323505 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3fc75f0b-9da3-455a-8942-73f182d46e75 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:55.332278 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3fc75f0b-9da3-455a-8942-73f182d46e75 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:55.333733 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-3fc75f0b-9da3-455a-8942-73f182d46e75 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:55.334920 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-3fc75f0b-9da3-455a-8942-73f182d46e75 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1729 microversion: 2.20 time: 0.164642 Oct 28 19:11:55.335557 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 368/762] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:55 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:56.124280 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-2174fce4-d777-4f96-ab96-c323403258fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:56.124866 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-2174fce4-d777-4f96-ab96-c323403258fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:56.131711 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2174fce4-d777-4f96-ab96-c323403258fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:56.132191 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2174fce4-d777-4f96-ab96-c323403258fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:56.132629 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2174fce4-d777-4f96-ab96-c323403258fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:56.133327 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2174fce4-d777-4f96-ab96-c323403258fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:56.134044 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2174fce4-d777-4f96-ab96-c323403258fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:56.134470 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2174fce4-d777-4f96-ab96-c323403258fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:56.277836 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-2174fce4-d777-4f96-ab96-c323403258fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:56.286474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-2174fce4-d777-4f96-ab96-c323403258fb tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.166050 Oct 28 19:11:56.287063 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 395/763] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:56 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:56.362192 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d3b076cf-fb93-4873-a3d8-c1af9a4b6326 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:56.362747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d3b076cf-fb93-4873-a3d8-c1af9a4b6326 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:56.365359 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=3 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:56.371523 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d3b076cf-fb93-4873-a3d8-c1af9a4b6326 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:56.372288 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d3b076cf-fb93-4873-a3d8-c1af9a4b6326 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:56.372864 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d3b076cf-fb93-4873-a3d8-c1af9a4b6326 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:56.373497 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d3b076cf-fb93-4873-a3d8-c1af9a4b6326 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:56.373967 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d3b076cf-fb93-4873-a3d8-c1af9a4b6326 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:56.374401 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d3b076cf-fb93-4873-a3d8-c1af9a4b6326 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:56.518533 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d3b076cf-fb93-4873-a3d8-c1af9a4b6326 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:56.527269 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d3b076cf-fb93-4873-a3d8-c1af9a4b6326 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:56.528738 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d3b076cf-fb93-4873-a3d8-c1af9a4b6326 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:56.529923 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d3b076cf-fb93-4873-a3d8-c1af9a4b6326 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1729 microversion: 2.20 time: 0.171979 Oct 28 19:11:56.543631 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 369/764] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:56 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:57.309647 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-09eeab93-011d-4b81-8df6-ea210595b565 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:57.311254 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-09eeab93-011d-4b81-8df6-ea210595b565 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:57.320005 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-09eeab93-011d-4b81-8df6-ea210595b565 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.320853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-09eeab93-011d-4b81-8df6-ea210595b565 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.321472 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-09eeab93-011d-4b81-8df6-ea210595b565 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.322354 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-09eeab93-011d-4b81-8df6-ea210595b565 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.322836 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-09eeab93-011d-4b81-8df6-ea210595b565 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.323560 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-09eeab93-011d-4b81-8df6-ea210595b565 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.466534 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-09eeab93-011d-4b81-8df6-ea210595b565 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:57.474682 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-09eeab93-011d-4b81-8df6-ea210595b565 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.168839 Oct 28 19:11:57.475649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 396/765] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:57 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:57.556502 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c58ca1ce-2453-4f97-a2fb-c5a69354f6f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:57.557282 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-c58ca1ce-2453-4f97-a2fb-c5a69354f6f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:57.565423 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c58ca1ce-2453-4f97-a2fb-c5a69354f6f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.565979 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c58ca1ce-2453-4f97-a2fb-c5a69354f6f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.566498 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c58ca1ce-2453-4f97-a2fb-c5a69354f6f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.567334 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c58ca1ce-2453-4f97-a2fb-c5a69354f6f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.567868 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c58ca1ce-2453-4f97-a2fb-c5a69354f6f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.568375 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c58ca1ce-2453-4f97-a2fb-c5a69354f6f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.718457 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c58ca1ce-2453-4f97-a2fb-c5a69354f6f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:57.734076 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c58ca1ce-2453-4f97-a2fb-c5a69354f6f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:57.736477 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c58ca1ce-2453-4f97-a2fb-c5a69354f6f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:57.737701 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-c58ca1ce-2453-4f97-a2fb-c5a69354f6f8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1729 microversion: 2.20 time: 0.185256 Oct 28 19:11:57.738267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 370/766] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:57 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:58.499134 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-162cef46-f7e6-441a-b8c1-0744d353e72f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:58.499735 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-162cef46-f7e6-441a-b8c1-0744d353e72f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:58.505846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-162cef46-f7e6-441a-b8c1-0744d353e72f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:58.506326 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-162cef46-f7e6-441a-b8c1-0744d353e72f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:58.506769 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-162cef46-f7e6-441a-b8c1-0744d353e72f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:58.507585 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-162cef46-f7e6-441a-b8c1-0744d353e72f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:58.508215 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-162cef46-f7e6-441a-b8c1-0744d353e72f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:58.509385 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-162cef46-f7e6-441a-b8c1-0744d353e72f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:58.648904 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-162cef46-f7e6-441a-b8c1-0744d353e72f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:58.662590 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-162cef46-f7e6-441a-b8c1-0744d353e72f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.167394 Oct 28 19:11:58.663235 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 397/767] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:58 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:58.764650 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b1c0c274-6d8f-4bcd-84ad-94ed20cb390d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:58.765281 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b1c0c274-6d8f-4bcd-84ad-94ed20cb390d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:58.771784 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b1c0c274-6d8f-4bcd-84ad-94ed20cb390d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:58.772274 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b1c0c274-6d8f-4bcd-84ad-94ed20cb390d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:58.772743 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b1c0c274-6d8f-4bcd-84ad-94ed20cb390d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:58.773419 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b1c0c274-6d8f-4bcd-84ad-94ed20cb390d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:58.773874 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b1c0c274-6d8f-4bcd-84ad-94ed20cb390d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:58.774301 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b1c0c274-6d8f-4bcd-84ad-94ed20cb390d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:58.936418 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b1c0c274-6d8f-4bcd-84ad-94ed20cb390d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:58.946158 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b1c0c274-6d8f-4bcd-84ad-94ed20cb390d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:58.947646 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b1c0c274-6d8f-4bcd-84ad-94ed20cb390d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:58.948837 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b1c0c274-6d8f-4bcd-84ad-94ed20cb390d tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1729 microversion: 2.20 time: 0.188315 Oct 28 19:11:58.949738 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 371/768] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:58 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:59.703427 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-44ca5f0a-ffeb-4f10-8405-d93cab643e53 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:59.704446 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-44ca5f0a-ffeb-4f10-8405-d93cab643e53 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:59.712117 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-44ca5f0a-ffeb-4f10-8405-d93cab643e53 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.712583 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-44ca5f0a-ffeb-4f10-8405-d93cab643e53 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.713013 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-44ca5f0a-ffeb-4f10-8405-d93cab643e53 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:59.713720 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-44ca5f0a-ffeb-4f10-8405-d93cab643e53 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.714327 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-44ca5f0a-ffeb-4f10-8405-d93cab643e53 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.714959 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-44ca5f0a-ffeb-4f10-8405-d93cab643e53 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:59.889351 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-44ca5f0a-ffeb-4f10-8405-d93cab643e53 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:59.898052 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-44ca5f0a-ffeb-4f10-8405-d93cab643e53 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.213044 Oct 28 19:11:59.898633 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 398/769] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:59 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:59.976946 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d592779c-81b1-4146-9051-a4cd7a808b1a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:59.977518 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d592779c-81b1-4146-9051-a4cd7a808b1a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:59.984587 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d592779c-81b1-4146-9051-a4cd7a808b1a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.985112 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d592779c-81b1-4146-9051-a4cd7a808b1a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.986085 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d592779c-81b1-4146-9051-a4cd7a808b1a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:59.986804 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d592779c-81b1-4146-9051-a4cd7a808b1a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.987295 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d592779c-81b1-4146-9051-a4cd7a808b1a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.987729 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d592779c-81b1-4146-9051-a4cd7a808b1a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:00.150442 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d592779c-81b1-4146-9051-a4cd7a808b1a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:00.161858 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d592779c-81b1-4146-9051-a4cd7a808b1a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:00.163922 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d592779c-81b1-4146-9051-a4cd7a808b1a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:00.165656 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d592779c-81b1-4146-9051-a4cd7a808b1a tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1729 microversion: 2.20 time: 0.192717 Oct 28 19:12:00.166356 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 372/770] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:59 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:00.923407 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-805b73e7-0c08-47a8-857d-3af044384f07 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:00.924084 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-805b73e7-0c08-47a8-857d-3af044384f07 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:00.930134 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-805b73e7-0c08-47a8-857d-3af044384f07 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:00.930612 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-805b73e7-0c08-47a8-857d-3af044384f07 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:00.931065 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-805b73e7-0c08-47a8-857d-3af044384f07 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:00.931757 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-805b73e7-0c08-47a8-857d-3af044384f07 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:00.932202 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-805b73e7-0c08-47a8-857d-3af044384f07 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:00.932619 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-805b73e7-0c08-47a8-857d-3af044384f07 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:01.095987 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-805b73e7-0c08-47a8-857d-3af044384f07 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:01.104787 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-805b73e7-0c08-47a8-857d-3af044384f07 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.185613 Oct 28 19:12:01.105372 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 399/771] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:00 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:01.193516 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-2ee8f78f-a852-46fd-87b2-3c0b8fc5e154 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:01.194413 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-2ee8f78f-a852-46fd-87b2-3c0b8fc5e154 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:01.200425 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2ee8f78f-a852-46fd-87b2-3c0b8fc5e154 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:01.200905 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2ee8f78f-a852-46fd-87b2-3c0b8fc5e154 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:01.201340 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2ee8f78f-a852-46fd-87b2-3c0b8fc5e154 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:01.202045 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2ee8f78f-a852-46fd-87b2-3c0b8fc5e154 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:01.202553 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2ee8f78f-a852-46fd-87b2-3c0b8fc5e154 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:01.203006 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2ee8f78f-a852-46fd-87b2-3c0b8fc5e154 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:01.365124 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2ee8f78f-a852-46fd-87b2-3c0b8fc5e154 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:01.374312 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2ee8f78f-a852-46fd-87b2-3c0b8fc5e154 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:01.375929 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2ee8f78f-a852-46fd-87b2-3c0b8fc5e154 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:01.377132 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-2ee8f78f-a852-46fd-87b2-3c0b8fc5e154 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1729 microversion: 2.20 time: 0.189058 Oct 28 19:12:01.377700 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 373/772] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:01 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:02.130323 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-b1124c44-43d2-4792-8334-f7796e91943f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:02.131084 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-b1124c44-43d2-4792-8334-f7796e91943f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:02.137292 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b1124c44-43d2-4792-8334-f7796e91943f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:02.137776 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b1124c44-43d2-4792-8334-f7796e91943f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:02.138206 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b1124c44-43d2-4792-8334-f7796e91943f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:02.138996 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b1124c44-43d2-4792-8334-f7796e91943f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:02.139460 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b1124c44-43d2-4792-8334-f7796e91943f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:02.139884 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b1124c44-43d2-4792-8334-f7796e91943f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:02.275219 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-b1124c44-43d2-4792-8334-f7796e91943f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:02.282915 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-b1124c44-43d2-4792-8334-f7796e91943f tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.156609 Oct 28 19:12:02.283505 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 400/773] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:02 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:02.402684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-adc4b398-6d6a-4267-b35c-5bdf21763428 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:02.403413 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-adc4b398-6d6a-4267-b35c-5bdf21763428 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:02.409673 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-adc4b398-6d6a-4267-b35c-5bdf21763428 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:02.410156 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-adc4b398-6d6a-4267-b35c-5bdf21763428 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:02.410599 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-adc4b398-6d6a-4267-b35c-5bdf21763428 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:02.411325 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-adc4b398-6d6a-4267-b35c-5bdf21763428 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:02.411796 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-adc4b398-6d6a-4267-b35c-5bdf21763428 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:02.412209 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-adc4b398-6d6a-4267-b35c-5bdf21763428 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:02.543815 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-adc4b398-6d6a-4267-b35c-5bdf21763428 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:02.552592 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-adc4b398-6d6a-4267-b35c-5bdf21763428 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:02.554018 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-adc4b398-6d6a-4267-b35c-5bdf21763428 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:02.555213 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-adc4b398-6d6a-4267-b35c-5bdf21763428 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1729 microversion: 2.20 time: 0.156556 Oct 28 19:12:02.555772 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 374/774] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:02 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:03.305786 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-3292d935-6670-4feb-bdd0-f8cf4d67c939 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:03.306314 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-3292d935-6670-4feb-bdd0-f8cf4d67c939 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:03.312307 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3292d935-6670-4feb-bdd0-f8cf4d67c939 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:03.312816 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3292d935-6670-4feb-bdd0-f8cf4d67c939 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:03.313256 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3292d935-6670-4feb-bdd0-f8cf4d67c939 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:03.313954 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3292d935-6670-4feb-bdd0-f8cf4d67c939 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:03.314417 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3292d935-6670-4feb-bdd0-f8cf4d67c939 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:03.314837 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3292d935-6670-4feb-bdd0-f8cf4d67c939 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:03.447294 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3292d935-6670-4feb-bdd0-f8cf4d67c939 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:03.455731 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-3292d935-6670-4feb-bdd0-f8cf4d67c939 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.153935 Oct 28 19:12:03.456297 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 401/775] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:03 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:03.581528 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-8fbf6446-4edd-44d0-9c92-528638d9b8e8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:03.582075 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-8fbf6446-4edd-44d0-9c92-528638d9b8e8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:03.588430 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8fbf6446-4edd-44d0-9c92-528638d9b8e8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:03.588909 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8fbf6446-4edd-44d0-9c92-528638d9b8e8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:03.589346 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8fbf6446-4edd-44d0-9c92-528638d9b8e8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:03.590053 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8fbf6446-4edd-44d0-9c92-528638d9b8e8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:03.590545 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8fbf6446-4edd-44d0-9c92-528638d9b8e8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:03.591002 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-8fbf6446-4edd-44d0-9c92-528638d9b8e8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:03.719739 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-8fbf6446-4edd-44d0-9c92-528638d9b8e8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:03.727787 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-8fbf6446-4edd-44d0-9c92-528638d9b8e8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:03.729242 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-8fbf6446-4edd-44d0-9c92-528638d9b8e8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:03.730401 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-8fbf6446-4edd-44d0-9c92-528638d9b8e8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1729 microversion: 2.20 time: 0.153443 Oct 28 19:12:03.730952 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 375/776] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:03 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:04.480061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-08e3958a-139b-480c-9d7e-611d637fbbe8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:04.480660 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-08e3958a-139b-480c-9d7e-611d637fbbe8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:04.487313 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-08e3958a-139b-480c-9d7e-611d637fbbe8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:04.487792 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-08e3958a-139b-480c-9d7e-611d637fbbe8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:04.488231 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-08e3958a-139b-480c-9d7e-611d637fbbe8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:04.488941 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-08e3958a-139b-480c-9d7e-611d637fbbe8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:04.489387 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-08e3958a-139b-480c-9d7e-611d637fbbe8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:04.489810 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-08e3958a-139b-480c-9d7e-611d637fbbe8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:04.619482 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-08e3958a-139b-480c-9d7e-611d637fbbe8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:04.627269 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-08e3958a-139b-480c-9d7e-611d637fbbe8 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.151074 Oct 28 19:12:04.627842 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 402/777] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:04 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:04.756981 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-79faeaf1-2185-45b7-af41-5065585e0621 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:04.757594 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-79faeaf1-2185-45b7-af41-5065585e0621 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:04.764656 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-79faeaf1-2185-45b7-af41-5065585e0621 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:04.765150 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-79faeaf1-2185-45b7-af41-5065585e0621 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:04.765593 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-79faeaf1-2185-45b7-af41-5065585e0621 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:04.766289 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-79faeaf1-2185-45b7-af41-5065585e0621 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:04.766745 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-79faeaf1-2185-45b7-af41-5065585e0621 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:04.767215 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-79faeaf1-2185-45b7-af41-5065585e0621 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:04.896375 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-79faeaf1-2185-45b7-af41-5065585e0621 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:04.904348 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-79faeaf1-2185-45b7-af41-5065585e0621 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:04.905794 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-79faeaf1-2185-45b7-af41-5065585e0621 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:04.907002 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-79faeaf1-2185-45b7-af41-5065585e0621 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1729 microversion: 2.20 time: 0.154651 Oct 28 19:12:04.907555 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 376/778] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:04 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:05.649935 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-fae8caf1-a291-448d-864a-d6e9071ac5d1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:05.650656 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-fae8caf1-a291-448d-864a-d6e9071ac5d1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:05.657314 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fae8caf1-a291-448d-864a-d6e9071ac5d1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.657789 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fae8caf1-a291-448d-864a-d6e9071ac5d1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.658227 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fae8caf1-a291-448d-864a-d6e9071ac5d1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:05.658908 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fae8caf1-a291-448d-864a-d6e9071ac5d1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.659417 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fae8caf1-a291-448d-864a-d6e9071ac5d1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.659840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fae8caf1-a291-448d-864a-d6e9071ac5d1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:05.795860 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-fae8caf1-a291-448d-864a-d6e9071ac5d1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ca34fc5c5743d0b5e3f4f97ae285e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c133d9594455182ac1b9ce13df65c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:05.803814 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-fae8caf1-a291-448d-864a-d6e9071ac5d1 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 200 len: 1522 microversion: 2.1 time: 0.157789 Oct 28 19:12:05.804630 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 403/779] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:05 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:05.932805 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-1e3be568-aa75-4757-9b74-4714217f3901 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:05.933377 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-1e3be568-aa75-4757-9b74-4714217f3901 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:05.941993 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1e3be568-aa75-4757-9b74-4714217f3901 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.942739 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1e3be568-aa75-4757-9b74-4714217f3901 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.943444 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1e3be568-aa75-4757-9b74-4714217f3901 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:05.944460 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1e3be568-aa75-4757-9b74-4714217f3901 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.945265 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1e3be568-aa75-4757-9b74-4714217f3901 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.945699 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-1e3be568-aa75-4757-9b74-4714217f3901 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:05.948234 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-c1a77268-a232-48b0-9d55-6c896ae6562b req-fb1f6961-8524-443c-a1fc-fde3074dc614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "713b7fcb-dff0-4d52-b071-05b218732625", "name": "network-vif-deleted", "tag": "86a8ea3e-f71c-4a62-92c2-eeca88631594"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:05.960029 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-c1a77268-a232-48b0-9d55-6c896ae6562b req-fb1f6961-8524-443c-a1fc-fde3074dc614 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.960507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-c1a77268-a232-48b0-9d55-6c896ae6562b req-fb1f6961-8524-443c-a1fc-fde3074dc614 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.961044 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-c1a77268-a232-48b0-9d55-6c896ae6562b req-fb1f6961-8524-443c-a1fc-fde3074dc614 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:05.973852 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-c1a77268-a232-48b0-9d55-6c896ae6562b req-fb1f6961-8524-443c-a1fc-fde3074dc614 service nova] Creating event network-vif-deleted:86a8ea3e-f71c-4a62-92c2-eeca88631594 for instance 713b7fcb-dff0-4d52-b071-05b218732625 on hv-cinder-86236 Oct 28 19:12:05.979863 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-c1a77268-a232-48b0-9d55-6c896ae6562b req-fb1f6961-8524-443c-a1fc-fde3074dc614 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035332 Oct 28 19:12:05.980908 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 404/780] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:06.084347 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1e3be568-aa75-4757-9b74-4714217f3901 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:06.094880 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1e3be568-aa75-4757-9b74-4714217f3901 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:06.097699 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-1e3be568-aa75-4757-9b74-4714217f3901 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:06.098907 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-1e3be568-aa75-4757-9b74-4714217f3901 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1729 microversion: 2.20 time: 0.170206 Oct 28 19:12:06.099495 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 377/781] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:05 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:06.827465 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-93ff4d56-1ef1-4da5-8e9e-05c6b26c2cd9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:06.828197 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-93ff4d56-1ef1-4da5-8e9e-05c6b26c2cd9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] [instance: 713b7fcb-dff0-4d52-b071-05b218732625] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:06.834226 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-93ff4d56-1ef1-4da5-8e9e-05c6b26c2cd9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:06.834703 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-93ff4d56-1ef1-4da5-8e9e-05c6b26c2cd9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:06.835165 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-93ff4d56-1ef1-4da5-8e9e-05c6b26c2cd9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:06.835845 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-93ff4d56-1ef1-4da5-8e9e-05c6b26c2cd9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:06.836292 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-93ff4d56-1ef1-4da5-8e9e-05c6b26c2cd9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:06.836711 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-93ff4d56-1ef1-4da5-8e9e-05c6b26c2cd9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:06.850099 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-93ff4d56-1ef1-4da5-8e9e-05c6b26c2cd9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] HTTP exception thrown: Instance 713b7fcb-dff0-4d52-b071-05b218732625 could not be found. Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-93ff4d56-1ef1-4da5-8e9e-05c6b26c2cd9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Request method failure captured: Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 HTTP/1.1 Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCglU6keeyc9TPFu8kh2CtSTL27mYzieTeXTMg3qjeLwWS58Om5L1-wzv5iwcJqqpWrZlbacG63VxxUqEcwRqSRGut_CvjvYM0Iq9ARpxZRlx9JGTssQ2QQL0BA1xD17zsswm8pySHHhA5LPoDCKLfH2eOnw8zYt795C9xWjuK8UoFU Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: 4f6c133d9594455182ac1b9ce13df65c Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-136875089 Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:12:06.851721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:12:06.853353 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4f6c133d9594455182ac1b9ce13df65c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:12:06.853353 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-ServerRescueNegativeTestJSON-136875089 Oct 28 19:12:06.853353 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: 4f6c133d9594455182ac1b9ce13df65c Oct 28 19:12:06.853353 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-136875089 Oct 28 19:12:06.853353 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-ServerRescueNegativeTestJSON-136875089-project Oct 28 19:12:06.853353 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:12:06.853353 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:12:06.853353 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: c8ca34fc5c5743d0b5e3f4f97ae285e0 Oct 28 19:12:06.853353 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-ServerRescueNegativeTestJSON-136875089-project Oct 28 19:12:06.853353 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: > Oct 28 19:12:06.853353 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Instance 713b7fcb-dff0-4d52-b071-05b218732625 could not be found. Oct 28 19:12:06.853353 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'id': '713b7fcb-dff0-4d52-b071-05b218732625'} Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 713b7fcb-dff0-4d52-b071-05b218732625 could not be found. Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:06.854260 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:06.855807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:06.855807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:12:06.855807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:12:06.855807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:06.855807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:06.855807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:06.855807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:06.855807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 713b7fcb-dff0-4d52-b071-05b218732625 could not be found. Oct 28 19:12:06.855807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:06.855807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:06.855807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:06.855807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:06.855807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:06.855807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:06.855807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:06.855807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:06.855807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 713b7fcb-dff0-4d52-b071-05b218732625 could not be found. Oct 28 19:12:06.855807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:06.857289 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-93ff4d56-1ef1-4da5-8e9e-05c6b26c2cd9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] Returning 404 to user: Instance 713b7fcb-dff0-4d52-b071-05b218732625 could not be found. {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:06.857289 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-93ff4d56-1ef1-4da5-8e9e-05c6b26c2cd9 tempest-ServerRescueNegativeTestJSON-136875089 tempest-ServerRescueNegativeTestJSON-136875089-project] 10.222.0.58 "GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625" status: 404 len: 111 microversion: 2.1 time: 0.029896 Oct 28 19:12:06.857289 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 405/782] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:06 2022] GET /compute/v2.1/servers/713b7fcb-dff0-4d52-b071-05b218732625 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:07.124745 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-ec7b93bc-7bd4-4305-b527-622de1456bf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:07.125344 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-ec7b93bc-7bd4-4305-b527-622de1456bf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:07.131774 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ec7b93bc-7bd4-4305-b527-622de1456bf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:07.132261 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ec7b93bc-7bd4-4305-b527-622de1456bf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:07.132700 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ec7b93bc-7bd4-4305-b527-622de1456bf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:07.133658 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ec7b93bc-7bd4-4305-b527-622de1456bf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:07.134114 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ec7b93bc-7bd4-4305-b527-622de1456bf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:07.134539 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ec7b93bc-7bd4-4305-b527-622de1456bf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:07.263774 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ec7b93bc-7bd4-4305-b527-622de1456bf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:07.273120 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ec7b93bc-7bd4-4305-b527-622de1456bf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:07.274571 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ec7b93bc-7bd4-4305-b527-622de1456bf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:07.275771 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-ec7b93bc-7bd4-4305-b527-622de1456bf8 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1729 microversion: 2.20 time: 0.155170 Oct 28 19:12:07.276338 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 378/783] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:07 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:08.302265 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-ea6761d6-3f08-4bf7-8f38-6e8708ad7725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:08.304097 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-ea6761d6-3f08-4bf7-8f38-6e8708ad7725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:08.314567 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:08.320544 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ea6761d6-3f08-4bf7-8f38-6e8708ad7725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:08.321256 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ea6761d6-3f08-4bf7-8f38-6e8708ad7725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:08.322190 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ea6761d6-3f08-4bf7-8f38-6e8708ad7725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:08.323346 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ea6761d6-3f08-4bf7-8f38-6e8708ad7725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:08.323747 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ea6761d6-3f08-4bf7-8f38-6e8708ad7725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:08.324494 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ea6761d6-3f08-4bf7-8f38-6e8708ad7725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:08.582844 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ea6761d6-3f08-4bf7-8f38-6e8708ad7725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:08.594541 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ea6761d6-3f08-4bf7-8f38-6e8708ad7725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:08.596536 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ea6761d6-3f08-4bf7-8f38-6e8708ad7725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:08.597971 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-ea6761d6-3f08-4bf7-8f38-6e8708ad7725 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1729 microversion: 2.20 time: 0.300335 Oct 28 19:12:08.599344 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 406/784] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:08 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1729 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:09.599848 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-39dc4a0e-4fd7-44b4-b117-1ad1f3e3c62a req-79ebe1f8-aa91-4a75-9b5b-dd367e1def6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c2187f-f4f1-4d25-96ff-2b032986f8b1", "name": "network-vif-plugged", "status": "completed", "tag": "b53160b4-c25e-42f7-a698-ec959ecf8b6d"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:09.613774 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-39dc4a0e-4fd7-44b4-b117-1ad1f3e3c62a req-79ebe1f8-aa91-4a75-9b5b-dd367e1def6d service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:09.614307 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-39dc4a0e-4fd7-44b4-b117-1ad1f3e3c62a req-79ebe1f8-aa91-4a75-9b5b-dd367e1def6d service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:09.614941 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-39dc4a0e-4fd7-44b4-b117-1ad1f3e3c62a req-79ebe1f8-aa91-4a75-9b5b-dd367e1def6d service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:09.632300 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-ff02f33c-88d3-4ff1-b8ed-a2b4c681ac03 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:09.635757 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-ff02f33c-88d3-4ff1-b8ed-a2b4c681ac03 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:09.647261 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-39dc4a0e-4fd7-44b4-b117-1ad1f3e3c62a req-79ebe1f8-aa91-4a75-9b5b-dd367e1def6d service nova] Creating event network-vif-plugged:b53160b4-c25e-42f7-a698-ec959ecf8b6d for instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 on hv-cinder-86236 Oct 28 19:12:09.647898 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ff02f33c-88d3-4ff1-b8ed-a2b4c681ac03 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:09.648956 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ff02f33c-88d3-4ff1-b8ed-a2b4c681ac03 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:09.650079 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ff02f33c-88d3-4ff1-b8ed-a2b4c681ac03 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:09.652753 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ff02f33c-88d3-4ff1-b8ed-a2b4c681ac03 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:09.654143 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ff02f33c-88d3-4ff1-b8ed-a2b4c681ac03 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:09.654439 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-39dc4a0e-4fd7-44b4-b117-1ad1f3e3c62a req-79ebe1f8-aa91-4a75-9b5b-dd367e1def6d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058386 Oct 28 19:12:09.655240 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-ff02f33c-88d3-4ff1-b8ed-a2b4c681ac03 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:09.655551 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 379/785] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:09.910588 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ff02f33c-88d3-4ff1-b8ed-a2b4c681ac03 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:09.927058 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ff02f33c-88d3-4ff1-b8ed-a2b4c681ac03 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:09.929544 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-ff02f33c-88d3-4ff1-b8ed-a2b4c681ac03 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:09.931789 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-ff02f33c-88d3-4ff1-b8ed-a2b4c681ac03 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1729 microversion: 2.20 time: 0.310049 Oct 28 19:12:09.932943 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 407/786] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:09 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1729 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:10.964331 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c9859b29-92b6-4226-9c5a-fc3d2feb6834 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:10.965127 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-c9859b29-92b6-4226-9c5a-fc3d2feb6834 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:10.972332 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c9859b29-92b6-4226-9c5a-fc3d2feb6834 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:10.972822 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c9859b29-92b6-4226-9c5a-fc3d2feb6834 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:10.973276 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c9859b29-92b6-4226-9c5a-fc3d2feb6834 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:10.973991 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c9859b29-92b6-4226-9c5a-fc3d2feb6834 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:10.974453 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c9859b29-92b6-4226-9c5a-fc3d2feb6834 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:10.975075 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c9859b29-92b6-4226-9c5a-fc3d2feb6834 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:11.153666 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c9859b29-92b6-4226-9c5a-fc3d2feb6834 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:11.169285 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c9859b29-92b6-4226-9c5a-fc3d2feb6834 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:11.172790 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c9859b29-92b6-4226-9c5a-fc3d2feb6834 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:11.174936 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-c9859b29-92b6-4226-9c5a-fc3d2feb6834 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1729 microversion: 2.20 time: 0.216404 Oct 28 19:12:11.176316 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 380/787] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:10 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:12.054390 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-18240b27-1c2b-46b6-ba87-4e9f9ea319ca tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Action: 'create', calling method: .version_select at 0x7f9bf680b550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-20984661"}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:12.210134 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-9aa9b219-c721-4281-90d9-307908eb0ae2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:12.211313 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-9aa9b219-c721-4281-90d9-307908eb0ae2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:12.218395 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9aa9b219-c721-4281-90d9-307908eb0ae2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:12.219252 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9aa9b219-c721-4281-90d9-307908eb0ae2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:12.219898 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9aa9b219-c721-4281-90d9-307908eb0ae2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:12.221421 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9aa9b219-c721-4281-90d9-307908eb0ae2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:12.222064 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9aa9b219-c721-4281-90d9-307908eb0ae2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:12.222498 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9aa9b219-c721-4281-90d9-307908eb0ae2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:12.414324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-18240b27-1c2b-46b6-ba87-4e9f9ea319ca tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.483418 Oct 28 19:12:12.415251 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 408/788] 10.222.0.58 () {60 vars in 1155 bytes} [Fri Oct 28 19:12:11 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 485 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 19:12:12.430067 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-0728761f-036a-480e-9deb-726e488b99f1 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Calling method '.version_select at 0x7f9bf662d9d0>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:12.450357 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-9aa9b219-c721-4281-90d9-307908eb0ae2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:12.466377 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-9aa9b219-c721-4281-90d9-307908eb0ae2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:12.470353 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-9aa9b219-c721-4281-90d9-307908eb0ae2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:12.472099 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-9aa9b219-c721-4281-90d9-307908eb0ae2 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1729 microversion: 2.20 time: 0.265981 Oct 28 19:12:12.477800 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 381/789] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:12 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1729 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:12:12.519622 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-0728761f-036a-480e-9deb-726e488b99f1 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/338ae2f5-f281-4ab0-af8d-e2c674d50b3b" status: 200 len: 343 microversion: 2.1 time: 0.093791 Oct 28 19:12:12.520200 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 409/790] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Oct 28 19:12:12 2022] GET /compute/v2.1/os-volumes/338ae2f5-f281-4ab0-af8d-e2c674d50b3b => generated 343 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:12:13.504064 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-36b26e8a-1582-41bc-afea-198114e9f99e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:13.504667 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-36b26e8a-1582-41bc-afea-198114e9f99e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:13.513294 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36b26e8a-1582-41bc-afea-198114e9f99e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:13.513979 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36b26e8a-1582-41bc-afea-198114e9f99e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:13.514530 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36b26e8a-1582-41bc-afea-198114e9f99e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:13.515531 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36b26e8a-1582-41bc-afea-198114e9f99e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:13.516441 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36b26e8a-1582-41bc-afea-198114e9f99e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:13.516981 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-36b26e8a-1582-41bc-afea-198114e9f99e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:13.537543 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-434adb31-5390-4b62-a6b9-267c6176d0bc tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Calling method '.version_select at 0x7f9bf6608a60>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:13.587694 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-434adb31-5390-4b62-a6b9-267c6176d0bc tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/338ae2f5-f281-4ab0-af8d-e2c674d50b3b" status: 200 len: 344 microversion: 2.1 time: 0.054062 Oct 28 19:12:13.588411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 410/791] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Oct 28 19:12:13 2022] GET /compute/v2.1/os-volumes/338ae2f5-f281-4ab0-af8d-e2c674d50b3b => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:12:13.601891 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-206f61b0-8974-48ea-94a7-7368711d45cc tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Action: 'create', calling method: .version_select at 0x7f9bf662df70>, body: {"snapshot": {"volume_id": "338ae2f5-f281-4ab0-af8d-e2c674d50b3b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1814085668"}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:13.656617 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-36b26e8a-1582-41bc-afea-198114e9f99e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:13.665084 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-36b26e8a-1582-41bc-afea-198114e9f99e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:13.666588 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-36b26e8a-1582-41bc-afea-198114e9f99e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:13.667859 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-36b26e8a-1582-41bc-afea-198114e9f99e tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1716 microversion: 2.20 time: 0.167853 Oct 28 19:12:13.668448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 382/792] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:13 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1716 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:13.774588 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-206f61b0-8974-48ea-94a7-7368711d45cc tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.176552 Oct 28 19:12:13.775455 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 411/793] 10.222.0.58 () {60 vars in 1162 bytes} [Fri Oct 28 19:12:13 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:12:13.786651 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-94900e4e-9175-4620-98b2-c3530af11dbd tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Calling method '.version_select at 0x7f9bf664e040>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:13.821118 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-94900e4e-9175-4620-98b2-c3530af11dbd tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/16274920-309c-4f98-a157-15f3f5b9554c" status: 200 len: 287 microversion: 2.1 time: 0.038504 Oct 28 19:12:13.821728 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 383/794] 10.222.0.58 () {58 vars in 1251 bytes} [Fri Oct 28 19:12:13 2022] GET /compute/v2.1/os-snapshots/16274920-309c-4f98-a157-15f3f5b9554c => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:13.833513 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-407f39ae-6af1-41f5-8255-bf8dbc907d65 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Calling method '.version_select at 0x7f9bf694f670>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:13.868008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-407f39ae-6af1-41f5-8255-bf8dbc907d65 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.038456 Oct 28 19:12:13.868610 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 412/795] 10.222.0.58 () {58 vars in 1140 bytes} [Fri Oct 28 19:12:13 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:13.880474 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-811a8e57-fa41-4f13-ac26-1389a4c483a8 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Calling method '.version_select at 0x7f9bf6476e50>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:13.912413 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-811a8e57-fa41-4f13-ac26-1389a4c483a8 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/16274920-309c-4f98-a157-15f3f5b9554c" status: 200 len: 287 microversion: 2.1 time: 0.035801 Oct 28 19:12:13.912982 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 384/796] 10.222.0.58 () {58 vars in 1251 bytes} [Fri Oct 28 19:12:13 2022] GET /compute/v2.1/os-snapshots/16274920-309c-4f98-a157-15f3f5b9554c => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:14.924871 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-852a9cc6-b651-4cb8-9445-50a9ab826634 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Calling method '.version_select at 0x7f9bf6608af0>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:14.956523 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-852a9cc6-b651-4cb8-9445-50a9ab826634 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/16274920-309c-4f98-a157-15f3f5b9554c" status: 200 len: 287 microversion: 2.1 time: 0.035650 Oct 28 19:12:14.957086 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 413/797] 10.222.0.58 () {58 vars in 1251 bytes} [Fri Oct 28 19:12:14 2022] GET /compute/v2.1/os-snapshots/16274920-309c-4f98-a157-15f3f5b9554c => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:15.969347 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-31d1926b-41ba-4f56-854e-f073d8dc3317 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Calling method '.version_select at 0x7f9bf661caf0>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:16.002338 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-31d1926b-41ba-4f56-854e-f073d8dc3317 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/16274920-309c-4f98-a157-15f3f5b9554c" status: 200 len: 287 microversion: 2.1 time: 0.037567 Oct 28 19:12:16.002915 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 385/798] 10.222.0.58 () {58 vars in 1251 bytes} [Fri Oct 28 19:12:15 2022] GET /compute/v2.1/os-snapshots/16274920-309c-4f98-a157-15f3f5b9554c => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:17.015715 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-2cfdb1ef-ad11-4925-8ccc-07fb23f252c1 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Calling method '.version_select at 0x7f9bf67a4ee0>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:17.047119 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-2cfdb1ef-ad11-4925-8ccc-07fb23f252c1 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/16274920-309c-4f98-a157-15f3f5b9554c" status: 200 len: 288 microversion: 2.1 time: 0.035353 Oct 28 19:12:17.047721 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 414/799] 10.222.0.58 () {58 vars in 1251 bytes} [Fri Oct 28 19:12:17 2022] GET /compute/v2.1/os-snapshots/16274920-309c-4f98-a157-15f3f5b9554c => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:17.048759 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c84db0bd-7012-4ea6-ba5d-2bd7be98bfed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:17.049268 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-c84db0bd-7012-4ea6-ba5d-2bd7be98bfed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:17.056147 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c84db0bd-7012-4ea6-ba5d-2bd7be98bfed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:17.056632 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c84db0bd-7012-4ea6-ba5d-2bd7be98bfed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:17.057966 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c84db0bd-7012-4ea6-ba5d-2bd7be98bfed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:17.058673 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c84db0bd-7012-4ea6-ba5d-2bd7be98bfed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:17.059163 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c84db0bd-7012-4ea6-ba5d-2bd7be98bfed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:17.059555 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-9bae1f25-bc46-4a4f-8ef8-bb36ab012e86 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Calling method '.version_select at 0x7f9bf6801dc0>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:17.059686 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c84db0bd-7012-4ea6-ba5d-2bd7be98bfed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:17.085127 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-c84db0bd-7012-4ea6-ba5d-2bd7be98bfed tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/ips" status: 200 len: 147 microversion: 2.1 time: 0.042262 Oct 28 19:12:17.085710 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 386/800] 10.222.0.58 () {58 vars in 1248 bytes} [Fri Oct 28 19:12:17 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/ips => generated 147 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:17.122941 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-9bae1f25-bc46-4a4f-8ef8-bb36ab012e86 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/16274920-309c-4f98-a157-15f3f5b9554c" status: 202 len: 0 microversion: 2.1 time: 0.067084 Oct 28 19:12:17.127600 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 415/801] 10.222.0.58 () {58 vars in 1254 bytes} [Fri Oct 28 19:12:17 2022] DELETE /compute/v2.1/os-snapshots/16274920-309c-4f98-a157-15f3f5b9554c => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:12:17.133151 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-cf0cd1f6-4e5b-4618-bdaf-f5b7742857cc tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Calling method '.version_select at 0x7f9bf664e040>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:17.165426 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-cf0cd1f6-4e5b-4618-bdaf-f5b7742857cc tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/16274920-309c-4f98-a157-15f3f5b9554c" status: 200 len: 287 microversion: 2.1 time: 0.036710 Oct 28 19:12:17.166324 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 387/802] 10.222.0.58 () {58 vars in 1251 bytes} [Fri Oct 28 19:12:17 2022] GET /compute/v2.1/os-snapshots/16274920-309c-4f98-a157-15f3f5b9554c => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:12:18.178832 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1ae2f2a1-9468-483b-8e76-f14c143e902e tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Calling method '.version_select at 0x7f9bf680b5e0>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:18.207573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-1ae2f2a1-9468-483b-8e76-f14c143e902e tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] HTTP exception thrown: Snapshot 16274920-309c-4f98-a157-15f3f5b9554c could not be found. Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1ae2f2a1-9468-483b-8e76-f14c143e902e tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Request method failure captured: Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: GET /compute/v2.1/os-snapshots/16274920-309c-4f98-a157-15f3f5b9554c HTTP/1.1 Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCmLynnqQ_p75A1GkjmJAO3SSn4ex7SslPe3Ds2_KvxZQmiJThOUa_OX0tWVwtRHkNCcZ7BagjnOeACIIuPu8tL1KdKxkk4hWcUON-ZaiNlDnatZKcCxv-u7oroir8CJFqX_3wlwG2dmEv5fXhfMDCpF67OSblVm6XZnmfZyjF7J2X4 Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: b5a1b2316802416e9a2cc021ce2c4dc1 Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-720813966 Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:12:18.209171 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:12:18.210787 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5a1b2316802416e9a2cc021ce2c4dc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5a1b2316802416e9a2cc021ce2c4dc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b5a1b2316802416e9a2cc021ce2c4dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b5a1b2316802416e9a2cc021ce2c4dc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:12:18.210787 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-VolumesSnapshotsTestJSON-720813966 Oct 28 19:12:18.210787 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: b5a1b2316802416e9a2cc021ce2c4dc1 Oct 28 19:12:18.210787 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-720813966 Oct 28 19:12:18.210787 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-VolumesSnapshotsTestJSON-720813966-project Oct 28 19:12:18.210787 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:12:18.210787 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:12:18.210787 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: 3cbc160f7ea04086902e47299a83eb03 Oct 28 19:12:18.210787 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-VolumesSnapshotsTestJSON-720813966-project Oct 28 19:12:18.210787 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: Oct 28 19:12:18.210787 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Snapshot 16274920-309c-4f98-a157-15f3f5b9554c could not be found. Oct 28 19:12:18.210787 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'id': '16274920-309c-4f98-a157-15f3f5b9554c'} Oct 28 19:12:18.210787 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:18.211846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:18.211846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 28 19:12:18.211846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 28 19:12:18.211846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 28 19:12:18.211846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 28 19:12:18.211846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 28 19:12:18.211846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 28 19:12:18.211846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:12:18.211846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:12:18.211846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:12:18.211846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:12:18.211846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:12:18.211846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:12:18.211846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:12:18.211846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:12:18.211846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 16274920-309c-4f98-a157-15f3f5b9554c could not be found. (HTTP 404) (Request-ID: req-6a6e30e8-72df-4fb9-a9a5-4b9782424fac) Oct 28 19:12:18.211846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:18.211846 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:12:18.213238 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 16274920-309c-4f98-a157-15f3f5b9554c could not be found. Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 28 19:12:18.214716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:18.216186 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 16274920-309c-4f98-a157-15f3f5b9554c could not be found. Oct 28 19:12:18.216186 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:18.216186 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:18.216186 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:18.216186 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:18.216186 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:18.216186 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:18.216186 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:18.216186 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:18.216186 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 16274920-309c-4f98-a157-15f3f5b9554c could not be found. Oct 28 19:12:18.216186 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:18.216186 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1ae2f2a1-9468-483b-8e76-f14c143e902e tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Returning 404 to user: Snapshot 16274920-309c-4f98-a157-15f3f5b9554c could not be found. {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:18.216186 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-1ae2f2a1-9468-483b-8e76-f14c143e902e tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/16274920-309c-4f98-a157-15f3f5b9554c" status: 404 len: 111 microversion: 2.1 time: 0.035655 Oct 28 19:12:18.216186 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 416/803] 10.222.0.58 () {58 vars in 1251 bytes} [Fri Oct 28 19:12:18 2022] GET /compute/v2.1/os-snapshots/16274920-309c-4f98-a157-15f3f5b9554c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:18.225528 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-dc1c6bcd-5d19-4215-80ef-bfabf20653c6 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Calling method '.version_select at 0x7f9bf661c3a0>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:18.288890 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-dc1c6bcd-5d19-4215-80ef-bfabf20653c6 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/338ae2f5-f281-4ab0-af8d-e2c674d50b3b" status: 202 len: 0 microversion: 2.1 time: 0.072637 Oct 28 19:12:18.289489 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 388/804] 10.222.0.58 () {58 vars in 1248 bytes} [Fri Oct 28 19:12:18 2022] DELETE /compute/v2.1/os-volumes/338ae2f5-f281-4ab0-af8d-e2c674d50b3b => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:12:18.298229 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-63879f06-fbfb-45f8-bc63-f9b2976936ff tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Calling method '.version_select at 0x7f9bf67e6d30>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:18.348641 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-63879f06-fbfb-45f8-bc63-f9b2976936ff tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/338ae2f5-f281-4ab0-af8d-e2c674d50b3b" status: 200 len: 343 microversion: 2.1 time: 0.054719 Oct 28 19:12:18.349235 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 417/805] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Oct 28 19:12:18 2022] GET /compute/v2.1/os-volumes/338ae2f5-f281-4ab0-af8d-e2c674d50b3b => generated 343 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:18.448993 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d1815995-4883-4a43-a737-49642c3dcc07 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca57ec70-6a3e-47f9-89bc-8ad0f7ae4b29"}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:18.453167 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d1815995-4883-4a43-a737-49642c3dcc07 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:18.461475 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d1815995-4883-4a43-a737-49642c3dcc07 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:18.461969 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d1815995-4883-4a43-a737-49642c3dcc07 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:18.462530 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d1815995-4883-4a43-a737-49642c3dcc07 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:18.463287 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d1815995-4883-4a43-a737-49642c3dcc07 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:18.463750 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d1815995-4883-4a43-a737-49642c3dcc07 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:18.464183 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d1815995-4883-4a43-a737-49642c3dcc07 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:18.482514 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=100 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:18.761522 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d1815995-4883-4a43-a737-49642c3dcc07 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "POST /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319522 Oct 28 19:12:18.762151 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 389/806] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Oct 28 19:12:18 2022] POST /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:19.364641 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-ffd55d37-b5dd-43e5-860b-721815e195b1 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Calling method '.version_select at 0x7f9bf68014c0>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:19.392236 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-ffd55d37-b5dd-43e5-860b-721815e195b1 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] HTTP exception thrown: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-ffd55d37-b5dd-43e5-860b-721815e195b1 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Request method failure captured: Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: GET /compute/v2.1/os-volumes/338ae2f5-f281-4ab0-af8d-e2c674d50b3b HTTP/1.1 Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCmLynnqQ_p75A1GkjmJAO3SSn4ex7SslPe3Ds2_KvxZQmiJThOUa_OX0tWVwtRHkNCcZ7BagjnOeACIIuPu8tL1KdKxkk4hWcUON-ZaiNlDnatZKcCxv-u7oroir8CJFqX_3wlwG2dmEv5fXhfMDCpF67OSblVm6XZnmfZyjF7J2X4 Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: b5a1b2316802416e9a2cc021ce2c4dc1 Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-720813966 Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:12:19.394212 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:12:19.395840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5a1b2316802416e9a2cc021ce2c4dc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5a1b2316802416e9a2cc021ce2c4dc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b5a1b2316802416e9a2cc021ce2c4dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b5a1b2316802416e9a2cc021ce2c4dc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:12:19.395840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-VolumesSnapshotsTestJSON-720813966 Oct 28 19:12:19.395840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: b5a1b2316802416e9a2cc021ce2c4dc1 Oct 28 19:12:19.395840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-720813966 Oct 28 19:12:19.395840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-VolumesSnapshotsTestJSON-720813966-project Oct 28 19:12:19.395840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:12:19.395840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:12:19.395840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: 3cbc160f7ea04086902e47299a83eb03 Oct 28 19:12:19.395840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-VolumesSnapshotsTestJSON-720813966-project Oct 28 19:12:19.395840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: Oct 28 19:12:19.395840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. Oct 28 19:12:19.395840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'id': '338ae2f5-f281-4ab0-af8d-e2c674d50b3b'} Oct 28 19:12:19.395840 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. (HTTP 404) (Request-ID: req-87925441-b9ae-45a1-8dfa-e9360d804d18) Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:19.396763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:12:19.398136 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 19:12:19.399569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:19.400920 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. Oct 28 19:12:19.400920 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.400920 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:19.400920 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.400920 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:19.400920 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:19.400920 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:19.400920 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:19.400920 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:19.400920 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. Oct 28 19:12:19.400920 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.400920 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-ffd55d37-b5dd-43e5-860b-721815e195b1 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Returning 404 to user: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:19.400920 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-ffd55d37-b5dd-43e5-860b-721815e195b1 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/338ae2f5-f281-4ab0-af8d-e2c674d50b3b" status: 404 len: 109 microversion: 2.1 time: 0.036009 Oct 28 19:12:19.400920 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 418/807] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Oct 28 19:12:19 2022] GET /compute/v2.1/os-volumes/338ae2f5-f281-4ab0-af8d-e2c674d50b3b => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:19.411567 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-99c1a6df-9872-4a47-842a-5dfb6d6f7b4d tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Calling method '.version_select at 0x7f9bf6475a60>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:19.440871 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.wsgi [None req-99c1a6df-9872-4a47-842a-5dfb6d6f7b4d tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] HTTP exception thrown: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-99c1a6df-9872-4a47-842a-5dfb6d6f7b4d tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Request method failure captured: Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: request: DELETE /compute/v2.1/os-volumes/338ae2f5-f281-4ab0-af8d-e2c674d50b3b HTTP/1.1 Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept: application/json Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept-Encoding: identity Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Connection: close Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Length: 0 Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Type: application/json Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Host: 10.222.0.58 Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Openstack-System-Scope: None Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Auth-Token: gAAAAABjXCmLynnqQ_p75A1GkjmJAO3SSn4ex7SslPe3Ds2_KvxZQmiJThOUa_OX0tWVwtRHkNCcZ7BagjnOeACIIuPu8tL1KdKxkk4hWcUON-ZaiNlDnatZKcCxv-u7oroir8CJFqX_3wlwG2dmEv5fXhfMDCpF67OSblVm6XZnmfZyjF7J2X4 Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Id: None Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Name: None Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Identity-Status: Confirmed Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Is-Admin-Project: True Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Id: default Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Name: Default Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Id: b5a1b2316802416e9a2cc021ce2c4dc1 Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-720813966 Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Role: member,reader Oct 28 19:12:19.442960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Roles: member,reader Oct 28 19:12:19.444516 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5a1b2316802416e9a2cc021ce2c4dc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5a1b2316802416e9a2cc021ce2c4dc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b5a1b2316802416e9a2cc021ce2c4dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b5a1b2316802416e9a2cc021ce2c4dc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:12:19.444516 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant: tempest-VolumesSnapshotsTestJSON-720813966 Oct 28 19:12:19.444516 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Id: b5a1b2316802416e9a2cc021ce2c4dc1 Oct 28 19:12:19.444516 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-720813966 Oct 28 19:12:19.444516 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User: tempest-VolumesSnapshotsTestJSON-720813966-project Oct 28 19:12:19.444516 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Id: default Oct 28 19:12:19.444516 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Name: Default Oct 28 19:12:19.444516 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Id: 3cbc160f7ea04086902e47299a83eb03 Oct 28 19:12:19.444516 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Name: tempest-VolumesSnapshotsTestJSON-720813966-project Oct 28 19:12:19.444516 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: method: Oct 28 19:12:19.444516 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: exception: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. Oct 28 19:12:19.444516 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: action_args: {'id': '338ae2f5-f281-4ab0-af8d-e2c674d50b3b'} Oct 28 19:12:19.444516 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. (HTTP 404) (Request-ID: req-d5ca5f49-c553-47f5-a7ff-6d5ed21b55f6) Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:19.445443 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 19:12:19.446930 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 19:12:19.448259 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:19.449581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. Oct 28 19:12:19.449581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.449581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:19.449581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.449581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:19.449581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:19.449581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:19.449581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:19.449581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:19.449581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. Oct 28 19:12:19.449581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.449581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-99c1a6df-9872-4a47-842a-5dfb6d6f7b4d tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Returning 404 to user: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. {{(pid=118875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:19.449581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-99c1a6df-9872-4a47-842a-5dfb6d6f7b4d tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/338ae2f5-f281-4ab0-af8d-e2c674d50b3b" status: 404 len: 109 microversion: 2.1 time: 0.038496 Oct 28 19:12:19.449581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 390/808] 10.222.0.58 () {58 vars in 1248 bytes} [Fri Oct 28 19:12:19 2022] DELETE /compute/v2.1/os-volumes/338ae2f5-f281-4ab0-af8d-e2c674d50b3b => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:19.452786 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a4bbe394-4285-4926-bf14-16baf951f8c6 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Calling method '.version_select at 0x7f9bf67a40d0>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:19.480930 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-a4bbe394-4285-4926-bf14-16baf951f8c6 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] HTTP exception thrown: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a4bbe394-4285-4926-bf14-16baf951f8c6 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Request method failure captured: Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: GET /compute/v2.1/os-volumes/338ae2f5-f281-4ab0-af8d-e2c674d50b3b HTTP/1.1 Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCmLynnqQ_p75A1GkjmJAO3SSn4ex7SslPe3Ds2_KvxZQmiJThOUa_OX0tWVwtRHkNCcZ7BagjnOeACIIuPu8tL1KdKxkk4hWcUON-ZaiNlDnatZKcCxv-u7oroir8CJFqX_3wlwG2dmEv5fXhfMDCpF67OSblVm6XZnmfZyjF7J2X4 Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: b5a1b2316802416e9a2cc021ce2c4dc1 Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-720813966 Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:12:19.483008 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:12:19.484532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5a1b2316802416e9a2cc021ce2c4dc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5a1b2316802416e9a2cc021ce2c4dc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b5a1b2316802416e9a2cc021ce2c4dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b5a1b2316802416e9a2cc021ce2c4dc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:12:19.484532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-VolumesSnapshotsTestJSON-720813966 Oct 28 19:12:19.484532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: b5a1b2316802416e9a2cc021ce2c4dc1 Oct 28 19:12:19.484532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-720813966 Oct 28 19:12:19.484532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-VolumesSnapshotsTestJSON-720813966-project Oct 28 19:12:19.484532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:12:19.484532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:12:19.484532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: 3cbc160f7ea04086902e47299a83eb03 Oct 28 19:12:19.484532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-VolumesSnapshotsTestJSON-720813966-project Oct 28 19:12:19.484532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: Oct 28 19:12:19.484532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. Oct 28 19:12:19.484532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'id': '338ae2f5-f281-4ab0-af8d-e2c674d50b3b'} Oct 28 19:12:19.484532 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. (HTTP 404) (Request-ID: req-8479f3f8-02cb-4c79-afa0-6315c3f52354) Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:19.486104 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:12:19.487459 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 19:12:19.488767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:19.490176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. Oct 28 19:12:19.490176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.490176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:19.490176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.490176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:19.490176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:19.490176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:19.490176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:19.490176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:19.490176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. Oct 28 19:12:19.490176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:19.490176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a4bbe394-4285-4926-bf14-16baf951f8c6 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] Returning 404 to user: Volume 338ae2f5-f281-4ab0-af8d-e2c674d50b3b could not be found. {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:19.490176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-a4bbe394-4285-4926-bf14-16baf951f8c6 tempest-VolumesSnapshotsTestJSON-720813966 tempest-VolumesSnapshotsTestJSON-720813966-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/338ae2f5-f281-4ab0-af8d-e2c674d50b3b" status: 404 len: 109 microversion: 2.1 time: 0.035464 Oct 28 19:12:19.490176 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 419/809] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Oct 28 19:12:19 2022] GET /compute/v2.1/os-volumes/338ae2f5-f281-4ab0-af8d-e2c674d50b3b => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:12:26.401856 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-4803a115-6da5-4bae-a263-de35df51b674 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:26.410338 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-4803a115-6da5-4bae-a263-de35df51b674 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:26.414179 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_api:SELECT=32 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:26.422790 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4803a115-6da5-4bae-a263-de35df51b674 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:26.423606 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4803a115-6da5-4bae-a263-de35df51b674 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:26.424223 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4803a115-6da5-4bae-a263-de35df51b674 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:26.425167 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4803a115-6da5-4bae-a263-de35df51b674 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:26.425817 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4803a115-6da5-4bae-a263-de35df51b674 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:26.426438 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-4803a115-6da5-4bae-a263-de35df51b674 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:26.466822 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-4803a115-6da5-4bae-a263-de35df51b674 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070321 Oct 28 19:12:26.467700 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 391/810] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Oct 28 19:12:26 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:26.478150 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=3 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:26.479583 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=87 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:26.485188 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-31d3b21a-39ed-4cf7-ab67-cada7d7b95d4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:26.485748 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-31d3b21a-39ed-4cf7-ab67-cada7d7b95d4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:26.493288 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-31d3b21a-39ed-4cf7-ab67-cada7d7b95d4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:26.493809 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-31d3b21a-39ed-4cf7-ab67-cada7d7b95d4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:26.494385 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-31d3b21a-39ed-4cf7-ab67-cada7d7b95d4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:26.495296 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-31d3b21a-39ed-4cf7-ab67-cada7d7b95d4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:26.495919 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-31d3b21a-39ed-4cf7-ab67-cada7d7b95d4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:26.496344 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-31d3b21a-39ed-4cf7-ab67-cada7d7b95d4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:26.528048 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-31d3b21a-39ed-4cf7-ab67-cada7d7b95d4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments/ca57ec70-6a3e-47f9-89bc-8ad0f7ae4b29" status: 200 len: 194 microversion: 2.1 time: 0.050098 Oct 28 19:12:26.528716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 420/811] 10.222.0.58 () {58 vars in 1413 bytes} [Fri Oct 28 19:12:26 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments/ca57ec70-6a3e-47f9-89bc-8ad0f7ae4b29 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:27.954073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b4d080d5-abfa-49d4-8064-716e631a1116 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c3ae298-1217-447e-8cab-23f3f31dbf8a"}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:27.956924 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b4d080d5-abfa-49d4-8064-716e631a1116 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:27.964087 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b4d080d5-abfa-49d4-8064-716e631a1116 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:27.964703 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b4d080d5-abfa-49d4-8064-716e631a1116 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:27.965111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b4d080d5-abfa-49d4-8064-716e631a1116 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:27.965947 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b4d080d5-abfa-49d4-8064-716e631a1116 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:27.966507 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b4d080d5-abfa-49d4-8064-716e631a1116 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:27.967035 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b4d080d5-abfa-49d4-8064-716e631a1116 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:28.270317 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b4d080d5-abfa-49d4-8064-716e631a1116 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "POST /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321042 Oct 28 19:12:28.271016 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 392/812] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Oct 28 19:12:27 2022] POST /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:12:35.888497 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a7fd187a-76a7-448a-af88-56163a057085 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:35.891360 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-a7fd187a-76a7-448a-af88-56163a057085 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:35.897378 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a7fd187a-76a7-448a-af88-56163a057085 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:35.897859 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a7fd187a-76a7-448a-af88-56163a057085 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:35.898298 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a7fd187a-76a7-448a-af88-56163a057085 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:35.899000 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a7fd187a-76a7-448a-af88-56163a057085 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:35.899485 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a7fd187a-76a7-448a-af88-56163a057085 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:35.899911 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a7fd187a-76a7-448a-af88-56163a057085 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:35.930208 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-a7fd187a-76a7-448a-af88-56163a057085 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045716 Oct 28 19:12:35.930795 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 421/813] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Oct 28 19:12:35 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:36.076123 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-62f80399-a31f-41cc-8520-17071509b8ce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:36.076997 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-62f80399-a31f-41cc-8520-17071509b8ce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:36.085027 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-62f80399-a31f-41cc-8520-17071509b8ce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.085576 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-62f80399-a31f-41cc-8520-17071509b8ce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.086330 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-62f80399-a31f-41cc-8520-17071509b8ce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.087191 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-62f80399-a31f-41cc-8520-17071509b8ce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.087700 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-62f80399-a31f-41cc-8520-17071509b8ce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.088167 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-62f80399-a31f-41cc-8520-17071509b8ce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.125468 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-62f80399-a31f-41cc-8520-17071509b8ce tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments/ca57ec70-6a3e-47f9-89bc-8ad0f7ae4b29" status: 200 len: 194 microversion: 2.1 time: 0.055046 Oct 28 19:12:36.126196 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 393/814] 10.222.0.58 () {58 vars in 1413 bytes} [Fri Oct 28 19:12:36 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments/ca57ec70-6a3e-47f9-89bc-8ad0f7ae4b29 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:36.138383 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-43754ae8-796f-497d-90d4-fa14ff5aa8d1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:36.138879 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-43754ae8-796f-497d-90d4-fa14ff5aa8d1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:36.145775 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-43754ae8-796f-497d-90d4-fa14ff5aa8d1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.146299 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-43754ae8-796f-497d-90d4-fa14ff5aa8d1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.146742 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-43754ae8-796f-497d-90d4-fa14ff5aa8d1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.147487 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-43754ae8-796f-497d-90d4-fa14ff5aa8d1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.147949 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-43754ae8-796f-497d-90d4-fa14ff5aa8d1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.148371 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-43754ae8-796f-497d-90d4-fa14ff5aa8d1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.247982 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.objects.instance [None req-43754ae8-796f-497d-90d4-fa14ff5aa8d1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lazy-loading 'services' on Instance uuid 87b9469f-9d6c-44e5-a945-1ef18dd7e49c {{(pid=118874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:12:36.342528 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-43754ae8-796f-497d-90d4-fa14ff5aa8d1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "DELETE /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments/ca57ec70-6a3e-47f9-89bc-8ad0f7ae4b29" status: 202 len: 0 microversion: 2.1 time: 0.207611 Oct 28 19:12:36.344140 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 422/815] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Oct 28 19:12:36 2022] DELETE /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments/ca57ec70-6a3e-47f9-89bc-8ad0f7ae4b29 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:12:38.571782 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-6c450761-646e-4472-ae26-97577bc85350 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:38.572378 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-6c450761-646e-4472-ae26-97577bc85350 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:38.582220 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6c450761-646e-4472-ae26-97577bc85350 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:38.582726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6c450761-646e-4472-ae26-97577bc85350 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:38.583262 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6c450761-646e-4472-ae26-97577bc85350 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:38.584032 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6c450761-646e-4472-ae26-97577bc85350 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:38.584500 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6c450761-646e-4472-ae26-97577bc85350 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:38.585003 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6c450761-646e-4472-ae26-97577bc85350 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:38.625601 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-6c450761-646e-4472-ae26-97577bc85350 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments/8c3ae298-1217-447e-8cab-23f3f31dbf8a" status: 200 len: 194 microversion: 2.1 time: 0.059356 Oct 28 19:12:38.627745 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 394/816] 10.222.0.58 () {58 vars in 1413 bytes} [Fri Oct 28 19:12:38 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments/8c3ae298-1217-447e-8cab-23f3f31dbf8a => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:38.639675 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4996f5b5-287e-47d7-990e-3493815ce5a6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:38.641161 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-4996f5b5-287e-47d7-990e-3493815ce5a6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:38.648418 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4996f5b5-287e-47d7-990e-3493815ce5a6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:38.648907 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4996f5b5-287e-47d7-990e-3493815ce5a6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:38.649572 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4996f5b5-287e-47d7-990e-3493815ce5a6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:38.650314 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4996f5b5-287e-47d7-990e-3493815ce5a6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:38.650776 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4996f5b5-287e-47d7-990e-3493815ce5a6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:38.651233 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4996f5b5-287e-47d7-990e-3493815ce5a6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:38.756793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.objects.instance [None req-4996f5b5-287e-47d7-990e-3493815ce5a6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lazy-loading 'services' on Instance uuid 87b9469f-9d6c-44e5-a945-1ef18dd7e49c {{(pid=118874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:12:38.849372 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-4996f5b5-287e-47d7-990e-3493815ce5a6 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "DELETE /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments/8c3ae298-1217-447e-8cab-23f3f31dbf8a" status: 202 len: 0 microversion: 2.1 time: 0.214391 Oct 28 19:12:38.850174 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 423/817] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Oct 28 19:12:38 2022] DELETE /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments/8c3ae298-1217-447e-8cab-23f3f31dbf8a => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:12:40.071014 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-293b3def-7555-4c53-a79b-8bdc7b478bd1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:40.073372 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-293b3def-7555-4c53-a79b-8bdc7b478bd1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:40.081235 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-293b3def-7555-4c53-a79b-8bdc7b478bd1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:40.081737 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-293b3def-7555-4c53-a79b-8bdc7b478bd1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:40.082211 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-293b3def-7555-4c53-a79b-8bdc7b478bd1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:40.082928 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-293b3def-7555-4c53-a79b-8bdc7b478bd1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:40.083419 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-293b3def-7555-4c53-a79b-8bdc7b478bd1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:40.083851 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-293b3def-7555-4c53-a79b-8bdc7b478bd1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:40.115316 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-293b3def-7555-4c53-a79b-8bdc7b478bd1 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049171 Oct 28 19:12:40.116204 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 395/818] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Oct 28 19:12:40 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:12:40.259977 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-e8ba0a19-e67d-4b4a-809a-e87fbf63665c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:40.263616 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-e8ba0a19-e67d-4b4a-809a-e87fbf63665c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:40.273329 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e8ba0a19-e67d-4b4a-809a-e87fbf63665c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:40.274042 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e8ba0a19-e67d-4b4a-809a-e87fbf63665c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:40.274683 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e8ba0a19-e67d-4b4a-809a-e87fbf63665c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:40.275751 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e8ba0a19-e67d-4b4a-809a-e87fbf63665c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:40.276433 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e8ba0a19-e67d-4b4a-809a-e87fbf63665c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:40.277061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e8ba0a19-e67d-4b4a-809a-e87fbf63665c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:40.313067 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-e8ba0a19-e67d-4b4a-809a-e87fbf63665c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063261 Oct 28 19:12:40.313689 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 424/819] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Oct 28 19:12:40 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:12:40.387495 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-5e1d4c28-a631-4b1c-94e3-e138e3713e0c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:40.387904 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-5e1d4c28-a631-4b1c-94e3-e138e3713e0c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:40.395811 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5e1d4c28-a631-4b1c-94e3-e138e3713e0c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:40.396546 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5e1d4c28-a631-4b1c-94e3-e138e3713e0c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:40.397242 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5e1d4c28-a631-4b1c-94e3-e138e3713e0c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:40.398309 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5e1d4c28-a631-4b1c-94e3-e138e3713e0c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:40.399071 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5e1d4c28-a631-4b1c-94e3-e138e3713e0c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:40.399737 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5e1d4c28-a631-4b1c-94e3-e138e3713e0c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:40.435391 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-5e1d4c28-a631-4b1c-94e3-e138e3713e0c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Going to try to terminate instance {{(pid=118875) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:12:40.520989 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-5e1d4c28-a631-4b1c-94e3-e138e3713e0c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "DELETE /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 204 len: 0 microversion: 2.1 time: 0.136957 Oct 28 19:12:40.522125 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 396/820] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Oct 28 19:12:40 2022] DELETE /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:12:40.537207 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-5c924796-768c-4795-b2bb-a23b602eb6fb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:40.538082 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-5c924796-768c-4795-b2bb-a23b602eb6fb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:40.547404 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c924796-768c-4795-b2bb-a23b602eb6fb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:40.547999 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c924796-768c-4795-b2bb-a23b602eb6fb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:40.548789 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c924796-768c-4795-b2bb-a23b602eb6fb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:40.549608 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c924796-768c-4795-b2bb-a23b602eb6fb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:40.550069 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c924796-768c-4795-b2bb-a23b602eb6fb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:40.550741 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c924796-768c-4795-b2bb-a23b602eb6fb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:40.690504 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-5c924796-768c-4795-b2bb-a23b602eb6fb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:40.698633 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-5c924796-768c-4795-b2bb-a23b602eb6fb tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 200 len: 1674 microversion: 2.1 time: 0.166445 Oct 28 19:12:40.699265 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 425/821] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:40 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:41.722866 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-5f009159-0577-494a-9f0e-de770b13320d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:41.723598 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-5f009159-0577-494a-9f0e-de770b13320d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:41.730355 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5f009159-0577-494a-9f0e-de770b13320d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:41.730855 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5f009159-0577-494a-9f0e-de770b13320d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:41.732597 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5f009159-0577-494a-9f0e-de770b13320d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:41.732597 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5f009159-0577-494a-9f0e-de770b13320d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:41.732597 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5f009159-0577-494a-9f0e-de770b13320d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:41.733158 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5f009159-0577-494a-9f0e-de770b13320d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:41.873413 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-5f009159-0577-494a-9f0e-de770b13320d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:41.881412 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-5f009159-0577-494a-9f0e-de770b13320d tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 200 len: 1674 microversion: 2.1 time: 0.163317 Oct 28 19:12:41.881987 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 397/822] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:41 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:42.905474 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-32949230-1edd-405d-9289-f315ff5d4513 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:42.906071 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-32949230-1edd-405d-9289-f315ff5d4513 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:42.912061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32949230-1edd-405d-9289-f315ff5d4513 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.912535 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32949230-1edd-405d-9289-f315ff5d4513 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.912968 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32949230-1edd-405d-9289-f315ff5d4513 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:42.913650 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32949230-1edd-405d-9289-f315ff5d4513 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.914089 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32949230-1edd-405d-9289-f315ff5d4513 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.914507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-32949230-1edd-405d-9289-f315ff5d4513 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:43.055005 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-32949230-1edd-405d-9289-f315ff5d4513 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:43.063485 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-32949230-1edd-405d-9289-f315ff5d4513 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 200 len: 1674 microversion: 2.1 time: 0.161928 Oct 28 19:12:43.064072 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 426/823] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:42 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:44.087253 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-fc0d8f9e-0590-4e06-b509-bc782fda479b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:44.088203 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-fc0d8f9e-0590-4e06-b509-bc782fda479b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:44.097384 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fc0d8f9e-0590-4e06-b509-bc782fda479b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:44.098667 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fc0d8f9e-0590-4e06-b509-bc782fda479b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:44.099344 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fc0d8f9e-0590-4e06-b509-bc782fda479b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:44.100234 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fc0d8f9e-0590-4e06-b509-bc782fda479b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:44.100736 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fc0d8f9e-0590-4e06-b509-bc782fda479b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:44.101180 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fc0d8f9e-0590-4e06-b509-bc782fda479b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:44.168911 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-fc0d8f9e-0590-4e06-b509-bc782fda479b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:44.178383 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-fc0d8f9e-0590-4e06-b509-bc782fda479b tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 200 len: 1606 microversion: 2.1 time: 0.095753 Oct 28 19:12:44.179164 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 398/824] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:44 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 1606 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:44.245657 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-24b60215-02bd-487b-8503-cd2f876f2dbb req-e8d4fabe-80ca-4a6c-89e2-a6135325acd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b9469f-9d6c-44e5-a945-1ef18dd7e49c", "name": "network-vif-deleted", "tag": "82fe4e85-bafc-41b9-aefe-cc9b20740a81"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:44.257024 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-24b60215-02bd-487b-8503-cd2f876f2dbb req-e8d4fabe-80ca-4a6c-89e2-a6135325acd6 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:44.257508 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-24b60215-02bd-487b-8503-cd2f876f2dbb req-e8d4fabe-80ca-4a6c-89e2-a6135325acd6 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:44.258328 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-24b60215-02bd-487b-8503-cd2f876f2dbb req-e8d4fabe-80ca-4a6c-89e2-a6135325acd6 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:44.270929 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-24b60215-02bd-487b-8503-cd2f876f2dbb req-e8d4fabe-80ca-4a6c-89e2-a6135325acd6 service nova] Creating event network-vif-deleted:82fe4e85-bafc-41b9-aefe-cc9b20740a81 for instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c on hv-cinder-86236 Oct 28 19:12:44.276897 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-24b60215-02bd-487b-8503-cd2f876f2dbb req-e8d4fabe-80ca-4a6c-89e2-a6135325acd6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034977 Oct 28 19:12:44.277517 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 427/825] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:45.203372 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-5f2501af-971e-49ed-add7-4d3e154b7744 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:45.204163 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-5f2501af-971e-49ed-add7-4d3e154b7744 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:45.211389 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5f2501af-971e-49ed-add7-4d3e154b7744 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:45.212222 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5f2501af-971e-49ed-add7-4d3e154b7744 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:45.212769 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5f2501af-971e-49ed-add7-4d3e154b7744 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:45.213660 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5f2501af-971e-49ed-add7-4d3e154b7744 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:45.214216 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5f2501af-971e-49ed-add7-4d3e154b7744 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:45.214732 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5f2501af-971e-49ed-add7-4d3e154b7744 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:45.259511 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5f2501af-971e-49ed-add7-4d3e154b7744 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:45.260183 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5f2501af-971e-49ed-add7-4d3e154b7744 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:45.260726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-5f2501af-971e-49ed-add7-4d3e154b7744 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:45.261293 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.objects.instance [None req-5f2501af-971e-49ed-add7-4d3e154b7744 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lazy-loading 'fault' on Instance uuid 87b9469f-9d6c-44e5-a945-1ef18dd7e49c {{(pid=118875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:12:45.311571 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-5f2501af-971e-49ed-add7-4d3e154b7744 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25c8936b368477880f429e818a321fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aaf60dd6c42808951c5f48f8fabd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:45.324216 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-5f2501af-971e-49ed-add7-4d3e154b7744 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 200 len: 1326 microversion: 2.1 time: 0.125795 Oct 28 19:12:45.325060 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 399/826] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:45 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 1326 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:46.348518 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-33068de8-d79b-49b1-b74f-09e8060de45c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:46.349209 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-33068de8-d79b-49b1-b74f-09e8060de45c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:46.355682 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-33068de8-d79b-49b1-b74f-09e8060de45c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:46.356835 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-33068de8-d79b-49b1-b74f-09e8060de45c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:46.356835 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-33068de8-d79b-49b1-b74f-09e8060de45c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:46.357407 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-33068de8-d79b-49b1-b74f-09e8060de45c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:46.357875 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-33068de8-d79b-49b1-b74f-09e8060de45c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:46.358309 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-33068de8-d79b-49b1-b74f-09e8060de45c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:46.372256 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-33068de8-d79b-49b1-b74f-09e8060de45c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] HTTP exception thrown: Instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c could not be found. Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-33068de8-d79b-49b1-b74f-09e8060de45c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Request method failure captured: Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c HTTP/1.1 Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCglmEo7fINkkMN3YKg4KhgV2NyFPFAlZQESiu85F_1iCqT5NHwD9mIgMUzIG0k5-3DsiGL7OOAGkzifQfgrsdmaW0oYpaV8M71YYnLAGW5bJiNQFkKHuiCYse70Fx5C_fEphacvWMZuiRww2MI4zQj-0rWDy-1wyQJSBNDPK6dEkm8 Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: 526aaf60dd6c42808951c5f48f8fabd2 Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-AttachVolumeTestJSON-37174478 Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:12:46.373928 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:12:46.376182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:12:46.376182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-AttachVolumeTestJSON-37174478 Oct 28 19:12:46.376182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: 526aaf60dd6c42808951c5f48f8fabd2 Oct 28 19:12:46.376182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-AttachVolumeTestJSON-37174478 Oct 28 19:12:46.376182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-AttachVolumeTestJSON-37174478-project Oct 28 19:12:46.376182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:12:46.376182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:12:46.376182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: a25c8936b368477880f429e818a321fa Oct 28 19:12:46.376182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-AttachVolumeTestJSON-37174478-project Oct 28 19:12:46.376182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: > Oct 28 19:12:46.376182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c could not be found. Oct 28 19:12:46.376182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'id': '87b9469f-9d6c-44e5-a945-1ef18dd7e49c'} Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c could not be found. Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:46.377114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:46.378638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:46.378638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:12:46.378638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:12:46.378638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:46.378638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:46.378638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:46.378638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:46.378638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c could not be found. Oct 28 19:12:46.378638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:46.378638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:46.378638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:46.378638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:46.378638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:46.378638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:46.378638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:46.378638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:46.378638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c could not be found. Oct 28 19:12:46.378638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:46.379982 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-33068de8-d79b-49b1-b74f-09e8060de45c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Returning 404 to user: Instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c could not be found. {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:46.379982 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-33068de8-d79b-49b1-b74f-09e8060de45c tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 404 len: 111 microversion: 2.1 time: 0.031688 Oct 28 19:12:46.379982 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 428/827] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:46 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:46.385082 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-2166119a-3b3a-47f4-9664-4e71828b1cc4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '.version_select at 0x7f9bf66803a0>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:46.406174 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-2166119a-3b3a-47f4-9664-4e71828b1cc4 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-12444273" status: 202 len: 0 microversion: 2.1 time: 0.025057 Oct 28 19:12:46.406752 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 400/828] 10.222.0.58 () {58 vars in 1215 bytes} [Fri Oct 28 19:12:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-12444273 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:12:46.489980 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-5c973139-da42-4d61-859d-65f5374d6302 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:46.492226 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-5c973139-da42-4d61-859d-65f5374d6302 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:46.498349 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c973139-da42-4d61-859d-65f5374d6302 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:46.498834 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c973139-da42-4d61-859d-65f5374d6302 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:46.500099 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c973139-da42-4d61-859d-65f5374d6302 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:46.501255 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c973139-da42-4d61-859d-65f5374d6302 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:46.501779 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c973139-da42-4d61-859d-65f5374d6302 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:46.502168 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5c973139-da42-4d61-859d-65f5374d6302 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:46.536405 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-5c973139-da42-4d61-859d-65f5374d6302 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050206 Oct 28 19:12:46.537158 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 429/829] 10.222.0.58 () {60 vars in 1343 bytes} [Fri Oct 28 19:12:46 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:46.620011 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-7002459f-b825-4318-bfca-bf0eb342b955 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:46.620011 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-7002459f-b825-4318-bfca-bf0eb342b955 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:46.622429 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7002459f-b825-4318-bfca-bf0eb342b955 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:46.623065 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7002459f-b825-4318-bfca-bf0eb342b955 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:46.623567 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7002459f-b825-4318-bfca-bf0eb342b955 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:46.625059 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7002459f-b825-4318-bfca-bf0eb342b955 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:46.625507 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7002459f-b825-4318-bfca-bf0eb342b955 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:46.625940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7002459f-b825-4318-bfca-bf0eb342b955 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:46.653899 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-7002459f-b825-4318-bfca-bf0eb342b955 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Going to try to terminate instance {{(pid=118875) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:12:46.710956 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:46.752934 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-7002459f-b825-4318-bfca-bf0eb342b955 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "DELETE /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 204 len: 0 microversion: 2.20 time: 0.141089 Oct 28 19:12:46.753633 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 401/830] 10.222.0.58 () {60 vars in 1280 bytes} [Fri Oct 28 19:12:46 2022] DELETE /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:12:46.763622 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-3139b8ab-bbe8-456f-b5f8-8623a5a73fea tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:46.764556 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-3139b8ab-bbe8-456f-b5f8-8623a5a73fea tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:46.772404 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3139b8ab-bbe8-456f-b5f8-8623a5a73fea tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:46.772901 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3139b8ab-bbe8-456f-b5f8-8623a5a73fea tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:46.773344 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3139b8ab-bbe8-456f-b5f8-8623a5a73fea tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:46.774051 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3139b8ab-bbe8-456f-b5f8-8623a5a73fea tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:46.774507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3139b8ab-bbe8-456f-b5f8-8623a5a73fea tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:46.774936 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3139b8ab-bbe8-456f-b5f8-8623a5a73fea tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:46.912182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3139b8ab-bbe8-456f-b5f8-8623a5a73fea tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:46.921671 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3139b8ab-bbe8-456f-b5f8-8623a5a73fea tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:46.923182 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3139b8ab-bbe8-456f-b5f8-8623a5a73fea tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:46.925384 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-3139b8ab-bbe8-456f-b5f8-8623a5a73fea tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1722 microversion: 2.20 time: 0.166150 Oct 28 19:12:46.926159 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 430/831] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:46 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:47.952083 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-ac39efe5-0ae7-4bdf-9571-919182791c4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:47.952763 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-ac39efe5-0ae7-4bdf-9571-919182791c4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:47.959640 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ac39efe5-0ae7-4bdf-9571-919182791c4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:47.960126 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ac39efe5-0ae7-4bdf-9571-919182791c4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:47.960562 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ac39efe5-0ae7-4bdf-9571-919182791c4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:47.961306 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ac39efe5-0ae7-4bdf-9571-919182791c4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:47.961708 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ac39efe5-0ae7-4bdf-9571-919182791c4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:47.962130 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ac39efe5-0ae7-4bdf-9571-919182791c4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:48.103074 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ac39efe5-0ae7-4bdf-9571-919182791c4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:48.112283 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ac39efe5-0ae7-4bdf-9571-919182791c4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:48.113743 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-ac39efe5-0ae7-4bdf-9571-919182791c4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:48.114942 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-ac39efe5-0ae7-4bdf-9571-919182791c4b tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1722 microversion: 2.20 time: 0.167210 Oct 28 19:12:48.115525 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 402/832] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:47 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:49.141421 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-291f360c-89f5-4415-9ce9-9f7693ff6fed tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:49.142673 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-291f360c-89f5-4415-9ce9-9f7693ff6fed tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:49.150605 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-291f360c-89f5-4415-9ce9-9f7693ff6fed tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:49.151601 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-291f360c-89f5-4415-9ce9-9f7693ff6fed tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:49.152052 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-291f360c-89f5-4415-9ce9-9f7693ff6fed tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:49.152775 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-291f360c-89f5-4415-9ce9-9f7693ff6fed tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:49.153229 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-291f360c-89f5-4415-9ce9-9f7693ff6fed tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:49.153653 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-291f360c-89f5-4415-9ce9-9f7693ff6fed tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:49.250878 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-291f360c-89f5-4415-9ce9-9f7693ff6fed tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:49.262425 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-291f360c-89f5-4415-9ce9-9f7693ff6fed tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:49.264456 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-291f360c-89f5-4415-9ce9-9f7693ff6fed tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e868bb74b33f467380562aec01a3d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bc75ee717c43b7811b0ab11c647f99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:49.266016 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-291f360c-89f5-4415-9ce9-9f7693ff6fed tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 200 len: 1655 microversion: 2.20 time: 0.128893 Oct 28 19:12:49.266669 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 431/833] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:49 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 1655 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:49.298423 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-da28afe5-ee6d-4f2c-bd46-8dd89bbb6ebc req-400835a6-85f0-4713-b5d5-26a839fc9f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c2187f-f4f1-4d25-96ff-2b032986f8b1", "name": "network-vif-deleted", "tag": "b53160b4-c25e-42f7-a698-ec959ecf8b6d"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:49.310467 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-da28afe5-ee6d-4f2c-bd46-8dd89bbb6ebc req-400835a6-85f0-4713-b5d5-26a839fc9f25 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:49.310959 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-da28afe5-ee6d-4f2c-bd46-8dd89bbb6ebc req-400835a6-85f0-4713-b5d5-26a839fc9f25 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:49.311459 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-da28afe5-ee6d-4f2c-bd46-8dd89bbb6ebc req-400835a6-85f0-4713-b5d5-26a839fc9f25 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:49.331959 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-da28afe5-ee6d-4f2c-bd46-8dd89bbb6ebc req-400835a6-85f0-4713-b5d5-26a839fc9f25 service nova] Creating event network-vif-deleted:b53160b4-c25e-42f7-a698-ec959ecf8b6d for instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 on hv-cinder-86236 Oct 28 19:12:49.338500 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-da28afe5-ee6d-4f2c-bd46-8dd89bbb6ebc req-400835a6-85f0-4713-b5d5-26a839fc9f25 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045267 Oct 28 19:12:49.339498 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 403/834] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:12:49.426686 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-86e4bf9c-aa7d-429f-8f3f-6b2d0a7081b0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:49.427446 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-86e4bf9c-aa7d-429f-8f3f-6b2d0a7081b0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:49.442446 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86e4bf9c-aa7d-429f-8f3f-6b2d0a7081b0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:49.443052 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86e4bf9c-aa7d-429f-8f3f-6b2d0a7081b0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:49.443427 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86e4bf9c-aa7d-429f-8f3f-6b2d0a7081b0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:49.444129 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86e4bf9c-aa7d-429f-8f3f-6b2d0a7081b0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:49.444573 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86e4bf9c-aa7d-429f-8f3f-6b2d0a7081b0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:49.445899 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-86e4bf9c-aa7d-429f-8f3f-6b2d0a7081b0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:49.462248 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-86e4bf9c-aa7d-429f-8f3f-6b2d0a7081b0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] HTTP exception thrown: Instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c could not be found. Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-86e4bf9c-aa7d-429f-8f3f-6b2d0a7081b0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Request method failure captured: Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: DELETE /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c HTTP/1.1 Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCglmEo7fINkkMN3YKg4KhgV2NyFPFAlZQESiu85F_1iCqT5NHwD9mIgMUzIG0k5-3DsiGL7OOAGkzifQfgrsdmaW0oYpaV8M71YYnLAGW5bJiNQFkKHuiCYse70Fx5C_fEphacvWMZuiRww2MI4zQj-0rWDy-1wyQJSBNDPK6dEkm8 Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: 526aaf60dd6c42808951c5f48f8fabd2 Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-AttachVolumeTestJSON-37174478 Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:12:49.463906 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:12:49.465527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:12:49.465527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-AttachVolumeTestJSON-37174478 Oct 28 19:12:49.465527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: 526aaf60dd6c42808951c5f48f8fabd2 Oct 28 19:12:49.465527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-AttachVolumeTestJSON-37174478 Oct 28 19:12:49.465527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-AttachVolumeTestJSON-37174478-project Oct 28 19:12:49.465527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:12:49.465527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:12:49.465527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: a25c8936b368477880f429e818a321fa Oct 28 19:12:49.465527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-AttachVolumeTestJSON-37174478-project Oct 28 19:12:49.465527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: > Oct 28 19:12:49.465527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c could not be found. Oct 28 19:12:49.465527 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'id': '87b9469f-9d6c-44e5-a945-1ef18dd7e49c'} Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c could not be found. Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:49.466511 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c could not be found. Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c could not be found. Oct 28 19:12:49.468033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:49.470831 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-86e4bf9c-aa7d-429f-8f3f-6b2d0a7081b0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Returning 404 to user: Instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c could not be found. {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:49.471960 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-86e4bf9c-aa7d-429f-8f3f-6b2d0a7081b0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "DELETE /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 404 len: 111 microversion: 2.1 time: 0.049968 Oct 28 19:12:49.472597 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 432/835] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Oct 28 19:12:49 2022] DELETE /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:49.484209 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-78a58ce3-6f70-47ff-a09c-a7fed78793c0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:49.485483 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-78a58ce3-6f70-47ff-a09c-a7fed78793c0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 87b9469f-9d6c-44e5-a945-1ef18dd7e49c] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:49.493395 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-78a58ce3-6f70-47ff-a09c-a7fed78793c0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:49.493895 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-78a58ce3-6f70-47ff-a09c-a7fed78793c0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:49.494718 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-78a58ce3-6f70-47ff-a09c-a7fed78793c0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:49.495670 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-78a58ce3-6f70-47ff-a09c-a7fed78793c0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:49.496352 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-78a58ce3-6f70-47ff-a09c-a7fed78793c0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:49.497014 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-78a58ce3-6f70-47ff-a09c-a7fed78793c0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:49.519987 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.wsgi [None req-78a58ce3-6f70-47ff-a09c-a7fed78793c0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] HTTP exception thrown: Instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c could not be found. Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-78a58ce3-6f70-47ff-a09c-a7fed78793c0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Request method failure captured: Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: request: GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c HTTP/1.1 Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept: application/json Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept-Encoding: identity Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Connection: close Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Length: 0 Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Type: application/json Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Host: 10.222.0.58 Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Openstack-System-Scope: None Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Auth-Token: gAAAAABjXCglmEo7fINkkMN3YKg4KhgV2NyFPFAlZQESiu85F_1iCqT5NHwD9mIgMUzIG0k5-3DsiGL7OOAGkzifQfgrsdmaW0oYpaV8M71YYnLAGW5bJiNQFkKHuiCYse70Fx5C_fEphacvWMZuiRww2MI4zQj-0rWDy-1wyQJSBNDPK6dEkm8 Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Id: None Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Name: None Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Identity-Status: Confirmed Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Is-Admin-Project: True Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Id: default Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Name: Default Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Id: 526aaf60dd6c42808951c5f48f8fabd2 Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Name: tempest-AttachVolumeTestJSON-37174478 Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Role: member,reader Oct 28 19:12:49.522119 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Roles: member,reader Oct 28 19:12:49.523845 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:12:49.523845 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant: tempest-AttachVolumeTestJSON-37174478 Oct 28 19:12:49.523845 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Id: 526aaf60dd6c42808951c5f48f8fabd2 Oct 28 19:12:49.523845 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Name: tempest-AttachVolumeTestJSON-37174478 Oct 28 19:12:49.523845 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User: tempest-AttachVolumeTestJSON-37174478-project Oct 28 19:12:49.523845 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Id: default Oct 28 19:12:49.523845 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Name: Default Oct 28 19:12:49.523845 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Id: a25c8936b368477880f429e818a321fa Oct 28 19:12:49.523845 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Name: tempest-AttachVolumeTestJSON-37174478-project Oct 28 19:12:49.523845 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: method: > Oct 28 19:12:49.523845 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: exception: Instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c could not be found. Oct 28 19:12:49.523845 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: action_args: {'id': '87b9469f-9d6c-44e5-a945-1ef18dd7e49c'} Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c could not be found. Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:49.524742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:49.526448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:49.526448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:12:49.526448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:12:49.526448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:49.526448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:49.526448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:49.526448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:49.526448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c could not be found. Oct 28 19:12:49.526448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:49.526448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:49.526448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:49.526448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:49.526448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:49.526448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:49.526448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:49.526448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:49.526448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c could not be found. Oct 28 19:12:49.526448 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:49.529915 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-78a58ce3-6f70-47ff-a09c-a7fed78793c0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Returning 404 to user: Instance 87b9469f-9d6c-44e5-a945-1ef18dd7e49c could not be found. {{(pid=118875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:49.531329 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-78a58ce3-6f70-47ff-a09c-a7fed78793c0 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c" status: 404 len: 111 microversion: 2.1 time: 0.052755 Oct 28 19:12:49.535027 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 404/836] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:49 2022] GET /compute/v2.1/servers/87b9469f-9d6c-44e5-a945-1ef18dd7e49c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:50.292388 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-46ea252b-ebe5-4f33-9f76-07e3cab114cf tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:50.293111 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-46ea252b-ebe5-4f33-9f76-07e3cab114cf tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:50.299772 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46ea252b-ebe5-4f33-9f76-07e3cab114cf tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:50.300255 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46ea252b-ebe5-4f33-9f76-07e3cab114cf tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:50.300710 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46ea252b-ebe5-4f33-9f76-07e3cab114cf tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:50.302061 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46ea252b-ebe5-4f33-9f76-07e3cab114cf tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:50.302687 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46ea252b-ebe5-4f33-9f76-07e3cab114cf tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:50.303314 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-46ea252b-ebe5-4f33-9f76-07e3cab114cf tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:50.319353 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-46ea252b-ebe5-4f33-9f76-07e3cab114cf tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] HTTP exception thrown: Instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 could not be found. Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-46ea252b-ebe5-4f33-9f76-07e3cab114cf tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Request method failure captured: Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 HTTP/1.1 Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCgU9nz-cCPlWPtgg2otnEHbawLUXC2pxeKBnCGvMpR9DIBONlkizSHp2dSyLqoxFEgXho1eX_8bWXo6WcZVjON_eSzEjeUbk5LgfieSF95ivXls0P2wweFmekTA3EdqsjTn_SsraqXtX2y1_4XoOMHW_Br2PQy7B-5Km5C35DzXOQM Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: 55bc75ee717c43b7811b0ab11c647f99 Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1524417465 Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:12:50.320888 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:12:50.322580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:12:50.322580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1524417465 Oct 28 19:12:50.322580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: 55bc75ee717c43b7811b0ab11c647f99 Oct 28 19:12:50.322580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1524417465 Oct 28 19:12:50.322580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-AttachVolumeShelveTestJSON-1524417465-project Oct 28 19:12:50.322580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:12:50.322580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:12:50.322580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: e868bb74b33f467380562aec01a3d3e9 Oct 28 19:12:50.322580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1524417465-project Oct 28 19:12:50.322580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: > Oct 28 19:12:50.322580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 could not be found. Oct 28 19:12:50.322580 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'id': '46c2187f-f4f1-4d25-96ff-2b032986f8b1'} Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 could not be found. Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:50.323411 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:50.324763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:50.324763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:12:50.324763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:12:50.324763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:50.324763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:50.324763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:50.324763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:50.324763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 could not be found. Oct 28 19:12:50.324763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.324763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:50.324763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.324763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:50.324763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:50.324763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:50.324763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:50.324763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:50.324763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 could not be found. Oct 28 19:12:50.324763 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.325862 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-46ea252b-ebe5-4f33-9f76-07e3cab114cf tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Returning 404 to user: Instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 could not be found. {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:50.325862 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-46ea252b-ebe5-4f33-9f76-07e3cab114cf tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 404 len: 111 microversion: 2.20 time: 0.034263 Oct 28 19:12:50.325862 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 433/837] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:50 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:12:50.332244 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-dd9512fb-d3f7-4214-bd9b-0dd497ad9b43 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '.version_select at 0x7f9bf66809d0>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:50.354164 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-dd9512fb-d3f7-4214-bd9b-0dd497ad9b43 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-158728537" status: 204 len: 0 microversion: 2.20 time: 0.026782 Oct 28 19:12:50.354747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 405/838] 10.222.0.58 () {60 vars in 1259 bytes} [Fri Oct 28 19:12:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-158728537 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:12:50.760876 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1b1272c3-8d0b-4fb6-836e-93a6a655df91 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:50.761369 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-1b1272c3-8d0b-4fb6-836e-93a6a655df91 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:50.768858 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1b1272c3-8d0b-4fb6-836e-93a6a655df91 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:50.769327 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1b1272c3-8d0b-4fb6-836e-93a6a655df91 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:50.770086 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1b1272c3-8d0b-4fb6-836e-93a6a655df91 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:50.770806 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1b1272c3-8d0b-4fb6-836e-93a6a655df91 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:50.771478 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1b1272c3-8d0b-4fb6-836e-93a6a655df91 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:50.772087 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1b1272c3-8d0b-4fb6-836e-93a6a655df91 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:50.788246 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-1b1272c3-8d0b-4fb6-836e-93a6a655df91 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] HTTP exception thrown: Instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f could not be found. Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1b1272c3-8d0b-4fb6-836e-93a6a655df91 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Request method failure captured: Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: DELETE /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f HTTP/1.1 Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCglmEo7fINkkMN3YKg4KhgV2NyFPFAlZQESiu85F_1iCqT5NHwD9mIgMUzIG0k5-3DsiGL7OOAGkzifQfgrsdmaW0oYpaV8M71YYnLAGW5bJiNQFkKHuiCYse70Fx5C_fEphacvWMZuiRww2MI4zQj-0rWDy-1wyQJSBNDPK6dEkm8 Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: 526aaf60dd6c42808951c5f48f8fabd2 Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-AttachVolumeTestJSON-37174478 Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:12:50.789793 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:12:50.791707 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:12:50.791707 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-AttachVolumeTestJSON-37174478 Oct 28 19:12:50.791707 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: 526aaf60dd6c42808951c5f48f8fabd2 Oct 28 19:12:50.791707 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-AttachVolumeTestJSON-37174478 Oct 28 19:12:50.791707 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-AttachVolumeTestJSON-37174478-project Oct 28 19:12:50.791707 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:12:50.791707 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:12:50.791707 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: a25c8936b368477880f429e818a321fa Oct 28 19:12:50.791707 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-AttachVolumeTestJSON-37174478-project Oct 28 19:12:50.791707 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: > Oct 28 19:12:50.791707 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f could not be found. Oct 28 19:12:50.791707 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'id': '13f3f032-9a74-4361-a6e5-8d7a2c09aa1f'} Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f could not be found. Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:50.792451 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f could not be found. Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f could not be found. Oct 28 19:12:50.794547 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.797098 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1b1272c3-8d0b-4fb6-836e-93a6a655df91 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Returning 404 to user: Instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f could not be found. {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:50.797098 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-1b1272c3-8d0b-4fb6-836e-93a6a655df91 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "DELETE /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 404 len: 111 microversion: 2.1 time: 0.034410 Oct 28 19:12:50.797098 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 434/839] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Oct 28 19:12:50 2022] DELETE /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:50.801841 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-11b6ebae-7aea-424e-a469-13edcd26a062 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:50.802634 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-11b6ebae-7aea-424e-a469-13edcd26a062 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] [instance: 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:50.811701 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-11b6ebae-7aea-424e-a469-13edcd26a062 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:50.812324 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-11b6ebae-7aea-424e-a469-13edcd26a062 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:50.812770 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-11b6ebae-7aea-424e-a469-13edcd26a062 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:50.813581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-11b6ebae-7aea-424e-a469-13edcd26a062 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:50.814230 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-11b6ebae-7aea-424e-a469-13edcd26a062 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:50.814647 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-11b6ebae-7aea-424e-a469-13edcd26a062 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:50.830663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.wsgi [None req-11b6ebae-7aea-424e-a469-13edcd26a062 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] HTTP exception thrown: Instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f could not be found. Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-11b6ebae-7aea-424e-a469-13edcd26a062 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Request method failure captured: Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: request: GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f HTTP/1.1 Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept: application/json Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept-Encoding: identity Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Connection: close Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Length: 0 Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Type: application/json Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Host: 10.222.0.58 Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Openstack-System-Scope: None Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Auth-Token: gAAAAABjXCglmEo7fINkkMN3YKg4KhgV2NyFPFAlZQESiu85F_1iCqT5NHwD9mIgMUzIG0k5-3DsiGL7OOAGkzifQfgrsdmaW0oYpaV8M71YYnLAGW5bJiNQFkKHuiCYse70Fx5C_fEphacvWMZuiRww2MI4zQj-0rWDy-1wyQJSBNDPK6dEkm8 Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Id: None Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Name: None Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Identity-Status: Confirmed Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Is-Admin-Project: True Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Id: default Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Name: Default Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Id: 526aaf60dd6c42808951c5f48f8fabd2 Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Name: tempest-AttachVolumeTestJSON-37174478 Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Role: member,reader Oct 28 19:12:50.832291 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Roles: member,reader Oct 28 19:12:50.833726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_526aaf60dd6c42808951c5f48f8fabd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:12:50.833726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant: tempest-AttachVolumeTestJSON-37174478 Oct 28 19:12:50.833726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Id: 526aaf60dd6c42808951c5f48f8fabd2 Oct 28 19:12:50.833726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Name: tempest-AttachVolumeTestJSON-37174478 Oct 28 19:12:50.833726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User: tempest-AttachVolumeTestJSON-37174478-project Oct 28 19:12:50.833726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Id: default Oct 28 19:12:50.833726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Name: Default Oct 28 19:12:50.833726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Id: a25c8936b368477880f429e818a321fa Oct 28 19:12:50.833726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Name: tempest-AttachVolumeTestJSON-37174478-project Oct 28 19:12:50.833726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: method: > Oct 28 19:12:50.833726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: exception: Instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f could not be found. Oct 28 19:12:50.833726 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: action_args: {'id': '13f3f032-9a74-4361-a6e5-8d7a2c09aa1f'} Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f could not be found. Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:50.834578 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:50.836260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:50.836260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:12:50.836260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:12:50.836260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:50.836260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:50.836260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:50.836260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:50.836260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f could not be found. Oct 28 19:12:50.836260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.836260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:50.836260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.836260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:50.836260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:50.836260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:50.836260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:50.836260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:50.836260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f could not be found. Oct 28 19:12:50.836260 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.838359 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-11b6ebae-7aea-424e-a469-13edcd26a062 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] Returning 404 to user: Instance 13f3f032-9a74-4361-a6e5-8d7a2c09aa1f could not be found. {{(pid=118875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:50.839577 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-11b6ebae-7aea-424e-a469-13edcd26a062 tempest-AttachVolumeTestJSON-37174478 tempest-AttachVolumeTestJSON-37174478-project] 10.222.0.58 "GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f" status: 404 len: 111 microversion: 2.1 time: 0.042973 Oct 28 19:12:50.840713 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 406/840] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:50 2022] GET /compute/v2.1/servers/13f3f032-9a74-4361-a6e5-8d7a2c09aa1f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:52.244181 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-efb9b2be-f89a-416a-bfc7-abb1e12e651f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:52.245319 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-efb9b2be-f89a-416a-bfc7-abb1e12e651f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:52.251748 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-efb9b2be-f89a-416a-bfc7-abb1e12e651f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:52.252402 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-efb9b2be-f89a-416a-bfc7-abb1e12e651f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:52.252988 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-efb9b2be-f89a-416a-bfc7-abb1e12e651f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:52.253849 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-efb9b2be-f89a-416a-bfc7-abb1e12e651f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:52.254405 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-efb9b2be-f89a-416a-bfc7-abb1e12e651f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:52.255035 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-efb9b2be-f89a-416a-bfc7-abb1e12e651f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:52.271332 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-efb9b2be-f89a-416a-bfc7-abb1e12e651f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] HTTP exception thrown: Instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 could not be found. Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-efb9b2be-f89a-416a-bfc7-abb1e12e651f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Request method failure captured: Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: DELETE /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 HTTP/1.1 Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCgU9nz-cCPlWPtgg2otnEHbawLUXC2pxeKBnCGvMpR9DIBONlkizSHp2dSyLqoxFEgXho1eX_8bWXo6WcZVjON_eSzEjeUbk5LgfieSF95ivXls0P2wweFmekTA3EdqsjTn_SsraqXtX2y1_4XoOMHW_Br2PQy7B-5Km5C35DzXOQM Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: 55bc75ee717c43b7811b0ab11c647f99 Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1524417465 Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:12:52.273009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:12:52.275210 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:12:52.275210 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1524417465 Oct 28 19:12:52.275210 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: 55bc75ee717c43b7811b0ab11c647f99 Oct 28 19:12:52.275210 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1524417465 Oct 28 19:12:52.275210 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-AttachVolumeShelveTestJSON-1524417465-project Oct 28 19:12:52.275210 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:12:52.275210 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:12:52.275210 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: e868bb74b33f467380562aec01a3d3e9 Oct 28 19:12:52.275210 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1524417465-project Oct 28 19:12:52.275210 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: > Oct 28 19:12:52.275210 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 could not be found. Oct 28 19:12:52.275210 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'id': '46c2187f-f4f1-4d25-96ff-2b032986f8b1'} Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 could not be found. Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:52.276397 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 could not be found. Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 could not be found. Oct 28 19:12:52.279818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:52.283584 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-efb9b2be-f89a-416a-bfc7-abb1e12e651f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Returning 404 to user: Instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 could not be found. {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:52.283584 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-efb9b2be-f89a-416a-bfc7-abb1e12e651f tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "DELETE /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 404 len: 111 microversion: 2.20 time: 0.034271 Oct 28 19:12:52.283584 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 435/841] 10.222.0.58 () {60 vars in 1280 bytes} [Fri Oct 28 19:12:52 2022] DELETE /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:12:52.291011 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-9e0612fc-27c9-4be2-99f6-b1f38e9fb439 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:52.291011 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-9e0612fc-27c9-4be2-99f6-b1f38e9fb439 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 46c2187f-f4f1-4d25-96ff-2b032986f8b1] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:52.294806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9e0612fc-27c9-4be2-99f6-b1f38e9fb439 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:52.295417 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9e0612fc-27c9-4be2-99f6-b1f38e9fb439 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:52.296414 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9e0612fc-27c9-4be2-99f6-b1f38e9fb439 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:52.297131 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9e0612fc-27c9-4be2-99f6-b1f38e9fb439 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:52.297590 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9e0612fc-27c9-4be2-99f6-b1f38e9fb439 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:52.298018 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-9e0612fc-27c9-4be2-99f6-b1f38e9fb439 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:52.313125 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.wsgi [None req-9e0612fc-27c9-4be2-99f6-b1f38e9fb439 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] HTTP exception thrown: Instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 could not be found. Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-9e0612fc-27c9-4be2-99f6-b1f38e9fb439 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Request method failure captured: Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: request: GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 HTTP/1.1 Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept: application/json Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept-Encoding: identity Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Connection: close Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Length: 0 Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Type: application/json Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Host: 10.222.0.58 Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Openstack-System-Scope: None Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Auth-Token: gAAAAABjXCgU9nz-cCPlWPtgg2otnEHbawLUXC2pxeKBnCGvMpR9DIBONlkizSHp2dSyLqoxFEgXho1eX_8bWXo6WcZVjON_eSzEjeUbk5LgfieSF95ivXls0P2wweFmekTA3EdqsjTn_SsraqXtX2y1_4XoOMHW_Br2PQy7B-5Km5C35DzXOQM Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Id: None Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Name: None Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Identity-Status: Confirmed Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Is-Admin-Project: True Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Id: default Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Name: Default Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Id: 55bc75ee717c43b7811b0ab11c647f99 Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1524417465 Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Role: member,reader Oct 28 19:12:52.314684 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Roles: member,reader Oct 28 19:12:52.316343 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:12:52.316343 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1524417465 Oct 28 19:12:52.316343 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Id: 55bc75ee717c43b7811b0ab11c647f99 Oct 28 19:12:52.316343 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1524417465 Oct 28 19:12:52.316343 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User: tempest-AttachVolumeShelveTestJSON-1524417465-project Oct 28 19:12:52.316343 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Id: default Oct 28 19:12:52.316343 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Name: Default Oct 28 19:12:52.316343 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Id: e868bb74b33f467380562aec01a3d3e9 Oct 28 19:12:52.316343 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1524417465-project Oct 28 19:12:52.316343 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: method: > Oct 28 19:12:52.316343 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: exception: Instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 could not be found. Oct 28 19:12:52.316343 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: action_args: {'id': '46c2187f-f4f1-4d25-96ff-2b032986f8b1'} Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 could not be found. Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:52.317122 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:52.318284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:52.318284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:12:52.318284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:12:52.318284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:52.318284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:52.318284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:52.318284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:52.318284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 could not be found. Oct 28 19:12:52.318284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:52.318284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:52.318284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:52.318284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:52.318284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:52.318284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:52.318284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:52.318284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:52.318284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 could not be found. Oct 28 19:12:52.318284 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:52.319635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-9e0612fc-27c9-4be2-99f6-b1f38e9fb439 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Returning 404 to user: Instance 46c2187f-f4f1-4d25-96ff-2b032986f8b1 could not be found. {{(pid=118875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:52.319635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-9e0612fc-27c9-4be2-99f6-b1f38e9fb439 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1" status: 404 len: 111 microversion: 2.20 time: 0.036162 Oct 28 19:12:52.319635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 407/842] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:52 2022] GET /compute/v2.1/servers/46c2187f-f4f1-4d25-96ff-2b032986f8b1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:12:53.480984 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4ea5a3ff-20bf-47cc-bca8-532c4faecfae tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:53.481513 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-4ea5a3ff-20bf-47cc-bca8-532c4faecfae tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:53.488003 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4ea5a3ff-20bf-47cc-bca8-532c4faecfae tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:53.488485 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4ea5a3ff-20bf-47cc-bca8-532c4faecfae tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:53.488918 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4ea5a3ff-20bf-47cc-bca8-532c4faecfae tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:53.489621 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4ea5a3ff-20bf-47cc-bca8-532c4faecfae tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:53.490954 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4ea5a3ff-20bf-47cc-bca8-532c4faecfae tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:53.491499 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4ea5a3ff-20bf-47cc-bca8-532c4faecfae tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:53.506010 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.wsgi [None req-4ea5a3ff-20bf-47cc-bca8-532c4faecfae tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] HTTP exception thrown: Instance 777c1a8e-485a-4333-a800-8586cdc8746b could not be found. Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4ea5a3ff-20bf-47cc-bca8-532c4faecfae tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Request method failure captured: Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: request: DELETE /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b HTTP/1.1 Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept: application/json Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Accept-Encoding: identity Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Connection: close Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Length: 0 Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Content-Type: application/json Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Host: 10.222.0.58 Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: Openstack-System-Scope: None Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Auth-Token: gAAAAABjXCgU9nz-cCPlWPtgg2otnEHbawLUXC2pxeKBnCGvMpR9DIBONlkizSHp2dSyLqoxFEgXho1eX_8bWXo6WcZVjON_eSzEjeUbk5LgfieSF95ivXls0P2wweFmekTA3EdqsjTn_SsraqXtX2y1_4XoOMHW_Br2PQy7B-5Km5C35DzXOQM Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Id: None Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Domain-Name: None Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Identity-Status: Confirmed Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Is-Admin-Project: True Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Id: default Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Domain-Name: Default Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Id: 55bc75ee717c43b7811b0ab11c647f99 Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1524417465 Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Role: member,reader Oct 28 19:12:53.507615 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Roles: member,reader Oct 28 19:12:53.509507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:12:53.509507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1524417465 Oct 28 19:12:53.509507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Id: 55bc75ee717c43b7811b0ab11c647f99 Oct 28 19:12:53.509507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1524417465 Oct 28 19:12:53.509507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User: tempest-AttachVolumeShelveTestJSON-1524417465-project Oct 28 19:12:53.509507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Id: default Oct 28 19:12:53.509507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Domain-Name: Default Oct 28 19:12:53.509507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Id: e868bb74b33f467380562aec01a3d3e9 Oct 28 19:12:53.509507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1524417465-project Oct 28 19:12:53.509507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: method: > Oct 28 19:12:53.509507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: exception: Instance 777c1a8e-485a-4333-a800-8586cdc8746b could not be found. Oct 28 19:12:53.509507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: action_args: {'id': '777c1a8e-485a-4333-a800-8586cdc8746b'} Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 777c1a8e-485a-4333-a800-8586cdc8746b could not be found. Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:53.510324 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 777c1a8e-485a-4333-a800-8586cdc8746b could not be found. Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 777c1a8e-485a-4333-a800-8586cdc8746b could not be found. Oct 28 19:12:53.512060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: ERROR nova.api.openstack.wsgi Oct 28 19:12:53.513761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4ea5a3ff-20bf-47cc-bca8-532c4faecfae tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Returning 404 to user: Instance 777c1a8e-485a-4333-a800-8586cdc8746b could not be found. {{(pid=118874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:53.513761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-4ea5a3ff-20bf-47cc-bca8-532c4faecfae tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "DELETE /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 404 len: 111 microversion: 2.20 time: 0.032382 Oct 28 19:12:53.513761 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 436/843] 10.222.0.58 () {60 vars in 1280 bytes} [Fri Oct 28 19:12:53 2022] DELETE /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:12:53.519768 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-18be0dad-ae64-46f6-b198-4bedb7791881 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:53.520314 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-18be0dad-ae64-46f6-b198-4bedb7791881 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] [instance: 777c1a8e-485a-4333-a800-8586cdc8746b] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:53.527237 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-18be0dad-ae64-46f6-b198-4bedb7791881 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:53.527775 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-18be0dad-ae64-46f6-b198-4bedb7791881 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:53.528219 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-18be0dad-ae64-46f6-b198-4bedb7791881 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:53.528954 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-18be0dad-ae64-46f6-b198-4bedb7791881 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:53.529390 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-18be0dad-ae64-46f6-b198-4bedb7791881 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:53.529819 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-18be0dad-ae64-46f6-b198-4bedb7791881 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:53.547522 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.wsgi [None req-18be0dad-ae64-46f6-b198-4bedb7791881 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] HTTP exception thrown: Instance 777c1a8e-485a-4333-a800-8586cdc8746b could not be found. Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-18be0dad-ae64-46f6-b198-4bedb7791881 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Request method failure captured: Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: request: GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b HTTP/1.1 Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept: application/json Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Accept-Encoding: identity Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Connection: close Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Length: 0 Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Content-Type: application/json Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Host: 10.222.0.58 Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: Openstack-System-Scope: None Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Auth-Token: gAAAAABjXCgU9nz-cCPlWPtgg2otnEHbawLUXC2pxeKBnCGvMpR9DIBONlkizSHp2dSyLqoxFEgXho1eX_8bWXo6WcZVjON_eSzEjeUbk5LgfieSF95ivXls0P2wweFmekTA3EdqsjTn_SsraqXtX2y1_4XoOMHW_Br2PQy7B-5Km5C35DzXOQM Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Id: None Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Domain-Name: None Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Identity-Status: Confirmed Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Is-Admin-Project: True Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Id: default Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Domain-Name: Default Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Id: 55bc75ee717c43b7811b0ab11c647f99 Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1524417465 Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Role: member,reader Oct 28 19:12:53.549088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Roles: member,reader Oct 28 19:12:53.550806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_55bc75ee717c43b7811b0ab11c647f99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}] Oct 28 19:12:53.550806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1524417465 Oct 28 19:12:53.550806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Id: 55bc75ee717c43b7811b0ab11c647f99 Oct 28 19:12:53.550806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1524417465 Oct 28 19:12:53.550806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User: tempest-AttachVolumeShelveTestJSON-1524417465-project Oct 28 19:12:53.550806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Id: default Oct 28 19:12:53.550806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Domain-Name: Default Oct 28 19:12:53.550806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Id: e868bb74b33f467380562aec01a3d3e9 Oct 28 19:12:53.550806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1524417465-project Oct 28 19:12:53.550806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: method: > Oct 28 19:12:53.550806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: exception: Instance 777c1a8e-485a-4333-a800-8586cdc8746b could not be found. Oct 28 19:12:53.550806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: action_args: {'id': '777c1a8e-485a-4333-a800-8586cdc8746b'} Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 777c1a8e-485a-4333-a800-8586cdc8746b could not be found. Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:53.551711 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:53.553111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:53.553111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:12:53.553111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:12:53.553111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:53.553111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:53.553111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:53.553111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:53.553111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 777c1a8e-485a-4333-a800-8586cdc8746b could not be found. Oct 28 19:12:53.553111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:53.553111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:53.553111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:53.553111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:53.553111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:53.553111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:53.553111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:53.553111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:53.553111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 777c1a8e-485a-4333-a800-8586cdc8746b could not be found. Oct 28 19:12:53.553111 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: ERROR nova.api.openstack.wsgi Oct 28 19:12:53.554363 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-18be0dad-ae64-46f6-b198-4bedb7791881 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] Returning 404 to user: Instance 777c1a8e-485a-4333-a800-8586cdc8746b could not be found. {{(pid=118875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:53.554363 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-18be0dad-ae64-46f6-b198-4bedb7791881 tempest-AttachVolumeShelveTestJSON-1524417465 tempest-AttachVolumeShelveTestJSON-1524417465-project] 10.222.0.58 "GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b" status: 404 len: 111 microversion: 2.20 time: 0.035987 Oct 28 19:12:53.554739 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 408/844] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:53 2022] GET /compute/v2.1/servers/777c1a8e-485a-4333-a800-8586cdc8746b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 19:13:03.486250 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=34 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:03.496964 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:03.590873 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-67fac3bd-9612-4c24-92d7-970677889474 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Action: 'create', calling method: .version_select at 0x7f9bf6608ee0>, body: {"keypair": {"name": "tempest-keypair-498608093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9ArnSFxwKd+BuodF3AGYt3CJNj6CT4Y+kDsNvvjX3F7dznyQg9TBf39EWHiI1fPeehFALmbXufSOYdBdPYhZoxQpTYWvciYA5TCT2H6xcdxM5nFMiwAQdL/GBOxyKjCQ=="}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:03.609263 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-67fac3bd-9612-4c24-92d7-970677889474 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Getting quotas for project 7ac6ccae08d64b5e97805897acdb9aa4. Resources: {'key_pairs'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:13:03.613953 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-67fac3bd-9612-4c24-92d7-970677889474 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Getting quotas for user f7c55684a73c4fd49a629012f2d4d661 and project 7ac6ccae08d64b5e97805897acdb9aa4. Resources: {'key_pairs'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:13:03.646812 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-67fac3bd-9612-4c24-92d7-970677889474 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.240260 Oct 28 19:13:03.648683 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 437/845] 10.222.0.58 () {60 vars in 1159 bytes} [Fri Oct 28 19:13:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:05.202295 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-82f7b6b6-384f-4e49-93f3-4067269e54ee tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1558231337", "imageRef": "cd92a575-ed0d-417b-b416-3471be3ba100", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac9f8668-4631-4b96-94e3-b9995a5420ce"}], "security_groups": [{"name": "tempest-securitygroup--935594473"}], "key_name": "tempest-keypair-498608093", "user_data": "}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:05.212184 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:05.213245 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=16 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:05.331371 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.network.neutron [None req-82f7b6b6-384f-4e49-93f3-4067269e54ee tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] validate_networks() for [('ac9f8668-4631-4b96-94e3-b9995a5420ce', None, None, None, None, None)] {{(pid=118875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:13:05.787370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-82f7b6b6-384f-4e49-93f3-4067269e54ee tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Flavor limits 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:13:05.787637 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-82f7b6b6-384f-4e49-93f3-4067269e54ee tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Image limits 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:13:05.788142 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-82f7b6b6-384f-4e49-93f3-4067269e54ee tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Flavor pref 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:13:05.788508 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-82f7b6b6-384f-4e49-93f3-4067269e54ee tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Image pref 0:0:0 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:13:05.789096 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.virt.hardware [None req-82f7b6b6-384f-4e49-93f3-4067269e54ee tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:13:05.803720 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-82f7b6b6-384f-4e49-93f3-4067269e54ee tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:05.804668 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-82f7b6b6-384f-4e49-93f3-4067269e54ee tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:05.805121 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-82f7b6b6-384f-4e49-93f3-4067269e54ee tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:05.805878 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-82f7b6b6-384f-4e49-93f3-4067269e54ee tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:05.806345 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-82f7b6b6-384f-4e49-93f3-4067269e54ee tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:05.806962 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-82f7b6b6-384f-4e49-93f3-4067269e54ee tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:05.827035 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-82f7b6b6-384f-4e49-93f3-4067269e54ee tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Getting quotas for project 7ac6ccae08d64b5e97805897acdb9aa4. Resources: {'ram', 'instances', 'cores'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:13:05.831695 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-82f7b6b6-384f-4e49-93f3-4067269e54ee tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Getting quotas for user f7c55684a73c4fd49a629012f2d4d661 and project 7ac6ccae08d64b5e97805897acdb9aa4. Resources: {'ram', 'instances', 'cores'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:13:05.855547 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-82f7b6b6-384f-4e49-93f3-4067269e54ee tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Going to run 1 instances... {{(pid=118875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:13:05.858515 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-82f7b6b6-384f-4e49-93f3-4067269e54ee tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 34677de8-0cd9-4298-9c60-4134aa2bff56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd92a575-ed0d-417b-b416-3471be3ba100',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:13:05.942142 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-82f7b6b6-384f-4e49-93f3-4067269e54ee tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.744206 Oct 28 19:13:05.943378 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 409/846] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Oct 28 19:13:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 19:13:05.963096 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-281fc066-b4dd-4d2d-8d89-54804ddd9eec tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:05.963815 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-281fc066-b4dd-4d2d-8d89-54804ddd9eec tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 34677de8-0cd9-4298-9c60-4134aa2bff56] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:06.083012 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-281fc066-b4dd-4d2d-8d89-54804ddd9eec tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:06.095044 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-281fc066-b4dd-4d2d-8d89-54804ddd9eec tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56" status: 200 len: 1241 microversion: 2.1 time: 0.139979 Oct 28 19:13:06.100416 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 438/847] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:05 2022] GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56 => generated 1241 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:07.122849 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-b3d07a25-6a93-4f02-87d6-240435709158 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:07.131760 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-b3d07a25-6a93-4f02-87d6-240435709158 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 34677de8-0cd9-4298-9c60-4134aa2bff56] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:07.155172 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b3d07a25-6a93-4f02-87d6-240435709158 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:07.155823 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b3d07a25-6a93-4f02-87d6-240435709158 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:07.156271 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b3d07a25-6a93-4f02-87d6-240435709158 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:07.157086 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b3d07a25-6a93-4f02-87d6-240435709158 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:07.157793 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b3d07a25-6a93-4f02-87d6-240435709158 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:07.158149 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-b3d07a25-6a93-4f02-87d6-240435709158 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:07.262189 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-b3d07a25-6a93-4f02-87d6-240435709158 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:07.272747 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-b3d07a25-6a93-4f02-87d6-240435709158 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56" status: 200 len: 1293 microversion: 2.1 time: 0.154054 Oct 28 19:13:07.288428 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 410/848] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:07 2022] GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56 => generated 1293 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:08.300040 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-453731a0-57f0-40db-a49e-7a0dcc48b1a4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:08.300899 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-453731a0-57f0-40db-a49e-7a0dcc48b1a4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 34677de8-0cd9-4298-9c60-4134aa2bff56] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:08.308858 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-453731a0-57f0-40db-a49e-7a0dcc48b1a4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:08.309971 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-453731a0-57f0-40db-a49e-7a0dcc48b1a4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:08.310481 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-453731a0-57f0-40db-a49e-7a0dcc48b1a4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:08.311229 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-453731a0-57f0-40db-a49e-7a0dcc48b1a4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:08.311685 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-453731a0-57f0-40db-a49e-7a0dcc48b1a4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:08.312111 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-453731a0-57f0-40db-a49e-7a0dcc48b1a4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:08.468131 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-453731a0-57f0-40db-a49e-7a0dcc48b1a4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:08.479407 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-453731a0-57f0-40db-a49e-7a0dcc48b1a4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56" status: 200 len: 1366 microversion: 2.1 time: 0.183346 Oct 28 19:13:08.480383 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 439/849] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:08 2022] GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:09.144670 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-7955abd2-05f1-4626-939e-8b587313808b req-7b382241-714b-4fdb-bd75-fb8a1f08c939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34677de8-0cd9-4298-9c60-4134aa2bff56", "tag": "7d5c7d41-2b9a-498e-8424-48c9b86cddb6"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:09.163736 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-7955abd2-05f1-4626-939e-8b587313808b req-7b382241-714b-4fdb-bd75-fb8a1f08c939 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:09.164507 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-7955abd2-05f1-4626-939e-8b587313808b req-7b382241-714b-4fdb-bd75-fb8a1f08c939 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:09.165129 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-7955abd2-05f1-4626-939e-8b587313808b req-7b382241-714b-4fdb-bd75-fb8a1f08c939 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:09.176990 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-7955abd2-05f1-4626-939e-8b587313808b req-7b382241-714b-4fdb-bd75-fb8a1f08c939 service nova] Creating event network-changed:7d5c7d41-2b9a-498e-8424-48c9b86cddb6 for instance 34677de8-0cd9-4298-9c60-4134aa2bff56 on hv-cinder-86236 Oct 28 19:13:09.181882 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-7955abd2-05f1-4626-939e-8b587313808b req-7b382241-714b-4fdb-bd75-fb8a1f08c939 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040877 Oct 28 19:13:09.182719 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 411/850] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:09.501657 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-547947db-34c9-4daa-a1fa-ec2695c427bf tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:09.502426 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-547947db-34c9-4daa-a1fa-ec2695c427bf tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 34677de8-0cd9-4298-9c60-4134aa2bff56] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:09.508716 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-547947db-34c9-4daa-a1fa-ec2695c427bf tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:09.509177 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-547947db-34c9-4daa-a1fa-ec2695c427bf tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:09.509610 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-547947db-34c9-4daa-a1fa-ec2695c427bf tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:09.510294 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-547947db-34c9-4daa-a1fa-ec2695c427bf tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:09.510738 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-547947db-34c9-4daa-a1fa-ec2695c427bf tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:09.511213 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-547947db-34c9-4daa-a1fa-ec2695c427bf tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:09.650618 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-547947db-34c9-4daa-a1fa-ec2695c427bf tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:09.659645 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-547947db-34c9-4daa-a1fa-ec2695c427bf tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56" status: 200 len: 1366 microversion: 2.1 time: 0.161847 Oct 28 19:13:09.660225 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 440/851] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:09 2022] GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:10.682620 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-002a23f3-5065-4cef-a49d-bbb0972aceda tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:10.683345 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-002a23f3-5065-4cef-a49d-bbb0972aceda tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 34677de8-0cd9-4298-9c60-4134aa2bff56] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:10.690256 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-002a23f3-5065-4cef-a49d-bbb0972aceda tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:10.690741 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-002a23f3-5065-4cef-a49d-bbb0972aceda tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:10.691207 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-002a23f3-5065-4cef-a49d-bbb0972aceda tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:10.691912 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-002a23f3-5065-4cef-a49d-bbb0972aceda tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:10.692358 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-002a23f3-5065-4cef-a49d-bbb0972aceda tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:10.692782 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-002a23f3-5065-4cef-a49d-bbb0972aceda tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:10.824866 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-002a23f3-5065-4cef-a49d-bbb0972aceda tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:10.832665 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-002a23f3-5065-4cef-a49d-bbb0972aceda tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56" status: 200 len: 1366 microversion: 2.1 time: 0.154639 Oct 28 19:13:10.833229 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 412/852] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:10 2022] GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:11.858490 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-290f9fbb-4c23-456f-a8a5-2d61ac13595e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:11.859181 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-290f9fbb-4c23-456f-a8a5-2d61ac13595e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 34677de8-0cd9-4298-9c60-4134aa2bff56] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:11.865158 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-290f9fbb-4c23-456f-a8a5-2d61ac13595e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:11.865671 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-290f9fbb-4c23-456f-a8a5-2d61ac13595e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:11.866103 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-290f9fbb-4c23-456f-a8a5-2d61ac13595e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:11.866789 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-290f9fbb-4c23-456f-a8a5-2d61ac13595e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:11.867267 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-290f9fbb-4c23-456f-a8a5-2d61ac13595e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:11.867692 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-290f9fbb-4c23-456f-a8a5-2d61ac13595e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:11.997935 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-290f9fbb-4c23-456f-a8a5-2d61ac13595e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:12.005764 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-290f9fbb-4c23-456f-a8a5-2d61ac13595e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56" status: 200 len: 1366 microversion: 2.1 time: 0.151760 Oct 28 19:13:12.006259 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 441/853] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:11 2022] GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:13.028706 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d5434230-e8fd-4d25-93a3-53bcfb8cc3e4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:13.030211 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d5434230-e8fd-4d25-93a3-53bcfb8cc3e4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 34677de8-0cd9-4298-9c60-4134aa2bff56] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:13.036805 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d5434230-e8fd-4d25-93a3-53bcfb8cc3e4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:13.037287 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d5434230-e8fd-4d25-93a3-53bcfb8cc3e4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:13.037724 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d5434230-e8fd-4d25-93a3-53bcfb8cc3e4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:13.038416 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d5434230-e8fd-4d25-93a3-53bcfb8cc3e4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:13.038868 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d5434230-e8fd-4d25-93a3-53bcfb8cc3e4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:13.039322 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d5434230-e8fd-4d25-93a3-53bcfb8cc3e4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:13.171618 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d5434230-e8fd-4d25-93a3-53bcfb8cc3e4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:13.179678 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d5434230-e8fd-4d25-93a3-53bcfb8cc3e4 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56" status: 200 len: 1366 microversion: 2.1 time: 0.154788 Oct 28 19:13:13.180243 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 413/854] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:13 2022] GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:14.202031 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-4c20a09d-2d42-4714-9c9c-bbc261b77943 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:14.202660 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-4c20a09d-2d42-4714-9c9c-bbc261b77943 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 34677de8-0cd9-4298-9c60-4134aa2bff56] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:14.209586 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4c20a09d-2d42-4714-9c9c-bbc261b77943 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:14.210060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4c20a09d-2d42-4714-9c9c-bbc261b77943 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:14.210493 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4c20a09d-2d42-4714-9c9c-bbc261b77943 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:14.211223 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4c20a09d-2d42-4714-9c9c-bbc261b77943 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:14.211651 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4c20a09d-2d42-4714-9c9c-bbc261b77943 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:14.212070 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-4c20a09d-2d42-4714-9c9c-bbc261b77943 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:14.361534 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-4c20a09d-2d42-4714-9c9c-bbc261b77943 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:14.369408 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-4c20a09d-2d42-4714-9c9c-bbc261b77943 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56" status: 200 len: 1366 microversion: 2.1 time: 0.171679 Oct 28 19:13:14.370114 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 442/855] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:14 2022] GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:14.418071 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-a8b5ac49-aa9e-4265-96d7-ddc198283f75 req-db2671b8-ae5b-4f0e-8fcc-d0a623cdc351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34677de8-0cd9-4298-9c60-4134aa2bff56", "name": "network-vif-plugged", "status": "completed", "tag": "7d5c7d41-2b9a-498e-8424-48c9b86cddb6"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:14.430207 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-a8b5ac49-aa9e-4265-96d7-ddc198283f75 req-db2671b8-ae5b-4f0e-8fcc-d0a623cdc351 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:14.431060 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-a8b5ac49-aa9e-4265-96d7-ddc198283f75 req-db2671b8-ae5b-4f0e-8fcc-d0a623cdc351 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:14.431820 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-a8b5ac49-aa9e-4265-96d7-ddc198283f75 req-db2671b8-ae5b-4f0e-8fcc-d0a623cdc351 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:14.444915 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-a8b5ac49-aa9e-4265-96d7-ddc198283f75 req-db2671b8-ae5b-4f0e-8fcc-d0a623cdc351 service nova] Creating event network-vif-plugged:7d5c7d41-2b9a-498e-8424-48c9b86cddb6 for instance 34677de8-0cd9-4298-9c60-4134aa2bff56 on hv-cinder-86236 Oct 28 19:13:14.449689 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-a8b5ac49-aa9e-4265-96d7-ddc198283f75 req-db2671b8-ae5b-4f0e-8fcc-d0a623cdc351 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035366 Oct 28 19:13:14.450462 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 414/856] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:15.398006 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-223101e9-58ad-4167-8e50-99d48da37600 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:15.398975 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-223101e9-58ad-4167-8e50-99d48da37600 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 34677de8-0cd9-4298-9c60-4134aa2bff56] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:15.409030 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-223101e9-58ad-4167-8e50-99d48da37600 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:15.409811 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-223101e9-58ad-4167-8e50-99d48da37600 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:15.410522 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-223101e9-58ad-4167-8e50-99d48da37600 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:15.411701 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-223101e9-58ad-4167-8e50-99d48da37600 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:15.412463 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-223101e9-58ad-4167-8e50-99d48da37600 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:15.413155 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-223101e9-58ad-4167-8e50-99d48da37600 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:15.619248 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-223101e9-58ad-4167-8e50-99d48da37600 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:15.630430 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-223101e9-58ad-4167-8e50-99d48da37600 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56" status: 200 len: 1366 microversion: 2.1 time: 0.239050 Oct 28 19:13:15.631980 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 443/857] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:15 2022] GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:13:16.663489 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell0:SELECT=2 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:16.664216 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell0:SELECT=6 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:16.668940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-905ff561-9ea5-45cb-9914-d95ec02ac02f tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:16.669658 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-905ff561-9ea5-45cb-9914-d95ec02ac02f tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 34677de8-0cd9-4298-9c60-4134aa2bff56] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:16.676730 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-905ff561-9ea5-45cb-9914-d95ec02ac02f tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:16.677209 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-905ff561-9ea5-45cb-9914-d95ec02ac02f tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:16.677644 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-905ff561-9ea5-45cb-9914-d95ec02ac02f tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:16.678333 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-905ff561-9ea5-45cb-9914-d95ec02ac02f tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:16.679319 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-905ff561-9ea5-45cb-9914-d95ec02ac02f tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:16.679758 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-905ff561-9ea5-45cb-9914-d95ec02ac02f tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:16.810831 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-905ff561-9ea5-45cb-9914-d95ec02ac02f tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:16.818532 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-905ff561-9ea5-45cb-9914-d95ec02ac02f tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56" status: 200 len: 1556 microversion: 2.1 time: 0.156612 Oct 28 19:13:16.819123 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 415/858] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:16 2022] GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:16.841164 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-28caa5b4-88a4-4a59-a745-0f9c76f33ef5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:16.841742 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-28caa5b4-88a4-4a59-a745-0f9c76f33ef5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 34677de8-0cd9-4298-9c60-4134aa2bff56] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:16.843778 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=6 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:16.849489 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-28caa5b4-88a4-4a59-a745-0f9c76f33ef5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:16.849973 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-28caa5b4-88a4-4a59-a745-0f9c76f33ef5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:16.850405 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-28caa5b4-88a4-4a59-a745-0f9c76f33ef5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:16.851165 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-28caa5b4-88a4-4a59-a745-0f9c76f33ef5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:16.851612 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-28caa5b4-88a4-4a59-a745-0f9c76f33ef5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:16.852033 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-28caa5b4-88a4-4a59-a745-0f9c76f33ef5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:16.929897 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-28caa5b4-88a4-4a59-a745-0f9c76f33ef5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092558 Oct 28 19:13:16.930493 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 444/859] 10.222.0.58 () {58 vars in 1275 bytes} [Fri Oct 28 19:13:16 2022] GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:18.174407 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-7b5039fe-e190-4b2d-9ff6-d678269da01f req-e7960b51-2cf4-4a67-a9ac-5363f479f7ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34677de8-0cd9-4298-9c60-4134aa2bff56", "tag": "7d5c7d41-2b9a-498e-8424-48c9b86cddb6"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:18.184806 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-7b5039fe-e190-4b2d-9ff6-d678269da01f req-e7960b51-2cf4-4a67-a9ac-5363f479f7ef service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:18.185855 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-7b5039fe-e190-4b2d-9ff6-d678269da01f req-e7960b51-2cf4-4a67-a9ac-5363f479f7ef service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:18.186306 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-7b5039fe-e190-4b2d-9ff6-d678269da01f req-e7960b51-2cf4-4a67-a9ac-5363f479f7ef service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:18.199627 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-7b5039fe-e190-4b2d-9ff6-d678269da01f req-e7960b51-2cf4-4a67-a9ac-5363f479f7ef service nova] Creating event network-changed:7d5c7d41-2b9a-498e-8424-48c9b86cddb6 for instance 34677de8-0cd9-4298-9c60-4134aa2bff56 on hv-cinder-86236 Oct 28 19:13:18.204746 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-7b5039fe-e190-4b2d-9ff6-d678269da01f req-e7960b51-2cf4-4a67-a9ac-5363f479f7ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034053 Oct 28 19:13:18.205354 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 416/860] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:33.778752 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:33.779592 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=34 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:33.784989 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-a052fa2b-0db0-47cf-8717-25a6fe4c066e tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:33.785515 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-a052fa2b-0db0-47cf-8717-25a6fe4c066e tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:33.792875 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a052fa2b-0db0-47cf-8717-25a6fe4c066e tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:33.793516 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a052fa2b-0db0-47cf-8717-25a6fe4c066e tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:33.793954 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a052fa2b-0db0-47cf-8717-25a6fe4c066e tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:33.794648 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a052fa2b-0db0-47cf-8717-25a6fe4c066e tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:33.795133 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a052fa2b-0db0-47cf-8717-25a6fe4c066e tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:33.795556 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-a052fa2b-0db0-47cf-8717-25a6fe4c066e tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:33.819818 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.objects.instance [None req-a052fa2b-0db0-47cf-8717-25a6fe4c066e tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lazy-loading 'flavor' on Instance uuid 429f9d21-c184-4baa-b7ea-bd94656890f3 {{(pid=118874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:13:33.891851 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-a052fa2b-0db0-47cf-8717-25a6fe4c066e tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "POST /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3/action" status: 202 len: 0 microversion: 2.1 time: 0.113736 Oct 28 19:13:33.892453 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 445/861] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Oct 28 19:13:33 2022] POST /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:13:33.898805 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:33.899630 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=32 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:33.904785 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-a14c3bb2-1c30-48f7-91de-5242228603df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:33.905502 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-a14c3bb2-1c30-48f7-91de-5242228603df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:33.912938 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a14c3bb2-1c30-48f7-91de-5242228603df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:33.913425 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a14c3bb2-1c30-48f7-91de-5242228603df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:33.913901 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a14c3bb2-1c30-48f7-91de-5242228603df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:33.914677 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a14c3bb2-1c30-48f7-91de-5242228603df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:33.915162 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a14c3bb2-1c30-48f7-91de-5242228603df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:33.915590 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a14c3bb2-1c30-48f7-91de-5242228603df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:34.059547 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a14c3bb2-1c30-48f7-91de-5242228603df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:34.067377 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-a14c3bb2-1c30-48f7-91de-5242228603df tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1565 microversion: 2.1 time: 0.170253 Oct 28 19:13:34.067940 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 417/862] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:33 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:13:35.091974 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-3d4f8106-9399-48d6-9e75-b13c6c3d02b0 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:35.092673 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-3d4f8106-9399-48d6-9e75-b13c6c3d02b0 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:35.098850 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3d4f8106-9399-48d6-9e75-b13c6c3d02b0 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:35.099363 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3d4f8106-9399-48d6-9e75-b13c6c3d02b0 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:35.099801 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3d4f8106-9399-48d6-9e75-b13c6c3d02b0 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:35.100490 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3d4f8106-9399-48d6-9e75-b13c6c3d02b0 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:35.100938 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3d4f8106-9399-48d6-9e75-b13c6c3d02b0 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:35.101362 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-3d4f8106-9399-48d6-9e75-b13c6c3d02b0 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:35.239536 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-3d4f8106-9399-48d6-9e75-b13c6c3d02b0 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:35.247632 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-3d4f8106-9399-48d6-9e75-b13c6c3d02b0 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1565 microversion: 2.1 time: 0.159947 Oct 28 19:13:35.248225 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 446/863] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:35 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:36.274763 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c43fea3e-6109-47bd-8c34-bc77a106f8f8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:36.275433 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-c43fea3e-6109-47bd-8c34-bc77a106f8f8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:36.282897 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c43fea3e-6109-47bd-8c34-bc77a106f8f8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:36.283565 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c43fea3e-6109-47bd-8c34-bc77a106f8f8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:36.284063 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c43fea3e-6109-47bd-8c34-bc77a106f8f8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:36.284928 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c43fea3e-6109-47bd-8c34-bc77a106f8f8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:36.285411 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c43fea3e-6109-47bd-8c34-bc77a106f8f8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:36.285932 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c43fea3e-6109-47bd-8c34-bc77a106f8f8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:36.447601 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-c43fea3e-6109-47bd-8c34-bc77a106f8f8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:36.457114 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-c43fea3e-6109-47bd-8c34-bc77a106f8f8 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1565 microversion: 2.1 time: 0.186295 Oct 28 19:13:36.457694 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 418/864] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:36 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1565 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:37.481648 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-7f9ff11b-6fe8-4e14-8576-c88b997ee241 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:37.484038 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-7f9ff11b-6fe8-4e14-8576-c88b997ee241 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:37.489892 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7f9ff11b-6fe8-4e14-8576-c88b997ee241 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:37.490078 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7f9ff11b-6fe8-4e14-8576-c88b997ee241 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:37.490362 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7f9ff11b-6fe8-4e14-8576-c88b997ee241 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:37.491077 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7f9ff11b-6fe8-4e14-8576-c88b997ee241 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:37.491535 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7f9ff11b-6fe8-4e14-8576-c88b997ee241 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:37.491961 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-7f9ff11b-6fe8-4e14-8576-c88b997ee241 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:37.697677 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-7f9ff11b-6fe8-4e14-8576-c88b997ee241 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:37.711575 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-7f9ff11b-6fe8-4e14-8576-c88b997ee241 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1565 microversion: 2.1 time: 0.233900 Oct 28 19:13:37.727206 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 447/865] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:37 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1565 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:38.748386 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-a708f93d-5b9a-4132-ae11-b589eba06728 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:38.749372 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-a708f93d-5b9a-4132-ae11-b589eba06728 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:38.757964 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a708f93d-5b9a-4132-ae11-b589eba06728 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:38.758457 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a708f93d-5b9a-4132-ae11-b589eba06728 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:38.758907 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a708f93d-5b9a-4132-ae11-b589eba06728 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:38.759669 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a708f93d-5b9a-4132-ae11-b589eba06728 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:38.760125 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a708f93d-5b9a-4132-ae11-b589eba06728 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:38.760563 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a708f93d-5b9a-4132-ae11-b589eba06728 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:38.922826 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a708f93d-5b9a-4132-ae11-b589eba06728 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:38.936509 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-a708f93d-5b9a-4132-ae11-b589eba06728 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1565 microversion: 2.1 time: 0.194206 Oct 28 19:13:38.937092 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 419/866] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:38 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1565 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:39.963163 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-2e8751db-6c45-4dc3-b4dc-a5ff88e9eb93 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:39.964585 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-2e8751db-6c45-4dc3-b4dc-a5ff88e9eb93 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:39.972667 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2e8751db-6c45-4dc3-b4dc-a5ff88e9eb93 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:39.973466 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2e8751db-6c45-4dc3-b4dc-a5ff88e9eb93 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:39.974366 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2e8751db-6c45-4dc3-b4dc-a5ff88e9eb93 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:39.975204 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2e8751db-6c45-4dc3-b4dc-a5ff88e9eb93 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:39.976219 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2e8751db-6c45-4dc3-b4dc-a5ff88e9eb93 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:39.976868 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-2e8751db-6c45-4dc3-b4dc-a5ff88e9eb93 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:40.152530 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-2e8751db-6c45-4dc3-b4dc-a5ff88e9eb93 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:40.161999 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-2e8751db-6c45-4dc3-b4dc-a5ff88e9eb93 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1565 microversion: 2.1 time: 0.203204 Oct 28 19:13:40.162585 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 448/867] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:39 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1565 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:13:41.187967 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-f268c918-ad29-4b43-8bc9-8cbfea35a275 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:41.189272 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-f268c918-ad29-4b43-8bc9-8cbfea35a275 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:41.195875 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f268c918-ad29-4b43-8bc9-8cbfea35a275 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:41.196366 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f268c918-ad29-4b43-8bc9-8cbfea35a275 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:41.196803 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f268c918-ad29-4b43-8bc9-8cbfea35a275 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:41.197514 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f268c918-ad29-4b43-8bc9-8cbfea35a275 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:41.197962 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f268c918-ad29-4b43-8bc9-8cbfea35a275 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:41.198412 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-f268c918-ad29-4b43-8bc9-8cbfea35a275 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:41.369959 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-f268c918-ad29-4b43-8bc9-8cbfea35a275 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:41.380312 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-f268c918-ad29-4b43-8bc9-8cbfea35a275 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1565 microversion: 2.1 time: 0.196505 Oct 28 19:13:41.381282 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 420/868] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:41 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1565 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:13:42.406112 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-6751026e-f449-4fc3-a2eb-8ac029432653 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:42.406806 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-6751026e-f449-4fc3-a2eb-8ac029432653 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:42.413254 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6751026e-f449-4fc3-a2eb-8ac029432653 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:42.413797 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6751026e-f449-4fc3-a2eb-8ac029432653 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:42.414156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6751026e-f449-4fc3-a2eb-8ac029432653 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:42.414855 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6751026e-f449-4fc3-a2eb-8ac029432653 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:42.415326 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6751026e-f449-4fc3-a2eb-8ac029432653 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:42.415748 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-6751026e-f449-4fc3-a2eb-8ac029432653 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:42.576195 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-6751026e-f449-4fc3-a2eb-8ac029432653 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:42.584807 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-6751026e-f449-4fc3-a2eb-8ac029432653 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1565 microversion: 2.1 time: 0.182618 Oct 28 19:13:42.585393 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 449/869] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:42 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1565 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:43.615219 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-7b553748-29e6-4bbc-924d-03d1240faf86 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:43.615219 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-7b553748-29e6-4bbc-924d-03d1240faf86 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:43.619180 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7b553748-29e6-4bbc-924d-03d1240faf86 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:43.619638 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7b553748-29e6-4bbc-924d-03d1240faf86 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:43.620076 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7b553748-29e6-4bbc-924d-03d1240faf86 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:43.620780 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7b553748-29e6-4bbc-924d-03d1240faf86 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:43.621324 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7b553748-29e6-4bbc-924d-03d1240faf86 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:43.621757 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-7b553748-29e6-4bbc-924d-03d1240faf86 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:43.791153 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-7b553748-29e6-4bbc-924d-03d1240faf86 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:43.802658 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-7b553748-29e6-4bbc-924d-03d1240faf86 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1565 microversion: 2.1 time: 0.195412 Oct 28 19:13:43.803307 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 421/870] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:43 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1565 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:44.830917 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f7880716-3434-4e25-ad10-471a5ea76926 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:44.831602 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f7880716-3434-4e25-ad10-471a5ea76926 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:44.837854 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7880716-3434-4e25-ad10-471a5ea76926 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:44.838325 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7880716-3434-4e25-ad10-471a5ea76926 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:44.838754 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7880716-3434-4e25-ad10-471a5ea76926 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:44.839471 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7880716-3434-4e25-ad10-471a5ea76926 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:44.839918 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7880716-3434-4e25-ad10-471a5ea76926 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:44.840370 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f7880716-3434-4e25-ad10-471a5ea76926 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:44.988882 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-f7880716-3434-4e25-ad10-471a5ea76926 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:44.997024 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f7880716-3434-4e25-ad10-471a5ea76926 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1565 microversion: 2.1 time: 0.170150 Oct 28 19:13:44.997644 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 450/871] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:44 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:46.029864 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-a25c020f-f32c-4286-a840-87d7dd34c456 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:46.030465 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-a25c020f-f32c-4286-a840-87d7dd34c456 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:46.037288 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a25c020f-f32c-4286-a840-87d7dd34c456 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:46.037761 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a25c020f-f32c-4286-a840-87d7dd34c456 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:46.038197 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a25c020f-f32c-4286-a840-87d7dd34c456 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:46.038889 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a25c020f-f32c-4286-a840-87d7dd34c456 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:46.039373 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a25c020f-f32c-4286-a840-87d7dd34c456 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:46.039791 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a25c020f-f32c-4286-a840-87d7dd34c456 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:46.175314 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-a25c020f-f32c-4286-a840-87d7dd34c456 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:46.183343 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-a25c020f-f32c-4286-a840-87d7dd34c456 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1565 microversion: 2.1 time: 0.157348 Oct 28 19:13:46.183920 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 422/872] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:46 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:47.207448 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-9eebd004-e710-4200-8965-3b21b56868e6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:47.208060 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-9eebd004-e710-4200-8965-3b21b56868e6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:47.214128 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9eebd004-e710-4200-8965-3b21b56868e6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:47.214610 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9eebd004-e710-4200-8965-3b21b56868e6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:47.215071 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9eebd004-e710-4200-8965-3b21b56868e6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:47.215791 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9eebd004-e710-4200-8965-3b21b56868e6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:47.216241 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9eebd004-e710-4200-8965-3b21b56868e6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:47.216672 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-9eebd004-e710-4200-8965-3b21b56868e6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:47.364394 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-9eebd004-e710-4200-8965-3b21b56868e6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:47.376718 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-9eebd004-e710-4200-8965-3b21b56868e6 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1566 microversion: 2.1 time: 0.172550 Oct 28 19:13:47.377596 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 451/873] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:47 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:47.401553 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-ed9687e2-fbe9-4441-b09e-35e811c5d4d2 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:47.402507 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-ed9687e2-fbe9-4441-b09e-35e811c5d4d2 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:47.409427 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ed9687e2-fbe9-4441-b09e-35e811c5d4d2 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:47.409916 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ed9687e2-fbe9-4441-b09e-35e811c5d4d2 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:47.410357 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ed9687e2-fbe9-4441-b09e-35e811c5d4d2 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:47.411099 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ed9687e2-fbe9-4441-b09e-35e811c5d4d2 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:47.411631 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ed9687e2-fbe9-4441-b09e-35e811c5d4d2 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:47.412054 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-ed9687e2-fbe9-4441-b09e-35e811c5d4d2 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:47.445348 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-ed9687e2-fbe9-4441-b09e-35e811c5d4d2 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118875) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 19:13:47.520089 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-ed9687e2-fbe9-4441-b09e-35e811c5d4d2 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "POST /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3/action" status: 202 len: 0 microversion: 2.1 time: 0.122051 Oct 28 19:13:47.520947 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 423/874] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Oct 28 19:13:47 2022] POST /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:13:47.533688 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-674aab42-ef69-4f0a-955a-1190dcc82ee5 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:47.534463 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-674aab42-ef69-4f0a-955a-1190dcc82ee5 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:47.542742 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-674aab42-ef69-4f0a-955a-1190dcc82ee5 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:47.543437 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-674aab42-ef69-4f0a-955a-1190dcc82ee5 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:47.543944 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-674aab42-ef69-4f0a-955a-1190dcc82ee5 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:47.545024 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-674aab42-ef69-4f0a-955a-1190dcc82ee5 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:47.545638 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-674aab42-ef69-4f0a-955a-1190dcc82ee5 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:47.546156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-674aab42-ef69-4f0a-955a-1190dcc82ee5 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:47.713211 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-674aab42-ef69-4f0a-955a-1190dcc82ee5 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:47.722162 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-674aab42-ef69-4f0a-955a-1190dcc82ee5 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1514 microversion: 2.1 time: 0.194810 Oct 28 19:13:47.722742 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 452/875] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:47 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:48.748313 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-aa38ae5d-7acd-4885-8a8b-129a04bc8cfa tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:48.749492 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-aa38ae5d-7acd-4885-8a8b-129a04bc8cfa tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:48.759101 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-aa38ae5d-7acd-4885-8a8b-129a04bc8cfa tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:48.759892 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-aa38ae5d-7acd-4885-8a8b-129a04bc8cfa tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:48.760504 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-aa38ae5d-7acd-4885-8a8b-129a04bc8cfa tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:48.761227 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-aa38ae5d-7acd-4885-8a8b-129a04bc8cfa tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:48.761872 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-aa38ae5d-7acd-4885-8a8b-129a04bc8cfa tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:48.762541 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-aa38ae5d-7acd-4885-8a8b-129a04bc8cfa tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:48.921261 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-aa38ae5d-7acd-4885-8a8b-129a04bc8cfa tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:48.932395 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-aa38ae5d-7acd-4885-8a8b-129a04bc8cfa tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1516 microversion: 2.1 time: 0.187901 Oct 28 19:13:48.932902 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 424/876] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:48 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1516 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:49.959945 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-554e6a5f-56d8-4122-b2b9-581671cca704 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:49.960558 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-554e6a5f-56d8-4122-b2b9-581671cca704 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:49.966613 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-554e6a5f-56d8-4122-b2b9-581671cca704 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:49.967158 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-554e6a5f-56d8-4122-b2b9-581671cca704 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:49.967610 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-554e6a5f-56d8-4122-b2b9-581671cca704 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:49.968318 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-554e6a5f-56d8-4122-b2b9-581671cca704 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:49.968771 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-554e6a5f-56d8-4122-b2b9-581671cca704 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:49.969198 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-554e6a5f-56d8-4122-b2b9-581671cca704 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:50.145160 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-554e6a5f-56d8-4122-b2b9-581671cca704 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:50.153556 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-554e6a5f-56d8-4122-b2b9-581671cca704 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1572 microversion: 2.1 time: 0.197418 Oct 28 19:13:50.154332 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 453/877] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:49 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1572 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:50.680032 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-38fd8695-10ac-4aa0-89df-dbbb87f32acf req-8ff1906c-9b37-47ba-832e-a154bf7c69bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "429f9d21-c184-4baa-b7ea-bd94656890f3", "name": "network-vif-unplugged", "status": "completed", "tag": "47bb3174-db66-4aef-9eaa-fa1018a14bec"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:50.689635 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-38fd8695-10ac-4aa0-89df-dbbb87f32acf req-8ff1906c-9b37-47ba-832e-a154bf7c69bf service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:50.690205 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-38fd8695-10ac-4aa0-89df-dbbb87f32acf req-8ff1906c-9b37-47ba-832e-a154bf7c69bf service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:50.690739 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-38fd8695-10ac-4aa0-89df-dbbb87f32acf req-8ff1906c-9b37-47ba-832e-a154bf7c69bf service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:50.705768 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-38fd8695-10ac-4aa0-89df-dbbb87f32acf req-8ff1906c-9b37-47ba-832e-a154bf7c69bf service nova] Creating event network-vif-unplugged:47bb3174-db66-4aef-9eaa-fa1018a14bec for instance 429f9d21-c184-4baa-b7ea-bd94656890f3 on hv-cinder-86236 Oct 28 19:13:50.708813 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-38fd8695-10ac-4aa0-89df-dbbb87f32acf req-8ff1906c-9b37-47ba-832e-a154bf7c69bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043875 Oct 28 19:13:50.709506 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 425/878] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:51.177625 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1e08091f-8aac-4261-968f-a4fad25549c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:51.178333 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-1e08091f-8aac-4261-968f-a4fad25549c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:51.184570 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1e08091f-8aac-4261-968f-a4fad25549c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:51.185077 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1e08091f-8aac-4261-968f-a4fad25549c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:51.185519 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1e08091f-8aac-4261-968f-a4fad25549c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:51.186311 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1e08091f-8aac-4261-968f-a4fad25549c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:51.186762 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1e08091f-8aac-4261-968f-a4fad25549c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:51.187209 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1e08091f-8aac-4261-968f-a4fad25549c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:51.375011 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-1e08091f-8aac-4261-968f-a4fad25549c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:51.383152 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-1e08091f-8aac-4261-968f-a4fad25549c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1572 microversion: 2.1 time: 0.209437 Oct 28 19:13:51.383737 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 454/879] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:51 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1572 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:52.410116 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-6c92ac78-a906-4171-a868-75ce3d568bfc tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:52.410742 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-6c92ac78-a906-4171-a868-75ce3d568bfc tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:52.417665 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6c92ac78-a906-4171-a868-75ce3d568bfc tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:52.418160 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6c92ac78-a906-4171-a868-75ce3d568bfc tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:52.418604 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6c92ac78-a906-4171-a868-75ce3d568bfc tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:52.419353 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6c92ac78-a906-4171-a868-75ce3d568bfc tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:52.419805 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6c92ac78-a906-4171-a868-75ce3d568bfc tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:52.420236 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-6c92ac78-a906-4171-a868-75ce3d568bfc tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:52.586357 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-6c92ac78-a906-4171-a868-75ce3d568bfc tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:52.594161 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-6c92ac78-a906-4171-a868-75ce3d568bfc tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1572 microversion: 2.1 time: 0.189804 Oct 28 19:13:52.594732 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 426/880] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:52 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1572 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:53.618704 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-e5b67214-0221-4e25-8b5b-9515e36956c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:53.619342 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-e5b67214-0221-4e25-8b5b-9515e36956c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:53.625370 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e5b67214-0221-4e25-8b5b-9515e36956c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:53.625861 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e5b67214-0221-4e25-8b5b-9515e36956c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:53.626339 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e5b67214-0221-4e25-8b5b-9515e36956c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:53.627067 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e5b67214-0221-4e25-8b5b-9515e36956c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:53.627526 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e5b67214-0221-4e25-8b5b-9515e36956c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:53.627953 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-e5b67214-0221-4e25-8b5b-9515e36956c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:53.772472 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-e5b67214-0221-4e25-8b5b-9515e36956c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:53.781414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-e5b67214-0221-4e25-8b5b-9515e36956c4 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1572 microversion: 2.1 time: 0.167099 Oct 28 19:13:53.781991 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 455/881] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:53 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1572 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:54.145285 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-a249d0c3-3de0-4a28-8435-369708fcdc3d tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:54.145780 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-a249d0c3-3de0-4a28-8435-369708fcdc3d tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 34677de8-0cd9-4298-9c60-4134aa2bff56] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:54.152320 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a249d0c3-3de0-4a28-8435-369708fcdc3d tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:54.152814 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a249d0c3-3de0-4a28-8435-369708fcdc3d tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:54.153254 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a249d0c3-3de0-4a28-8435-369708fcdc3d tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:54.153960 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a249d0c3-3de0-4a28-8435-369708fcdc3d tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:54.154415 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a249d0c3-3de0-4a28-8435-369708fcdc3d tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:54.154842 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-a249d0c3-3de0-4a28-8435-369708fcdc3d tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:54.178593 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-a249d0c3-3de0-4a28-8435-369708fcdc3d tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56/ips" status: 200 len: 150 microversion: 2.1 time: 0.037707 Oct 28 19:13:54.179203 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 427/882] 10.222.0.58 () {58 vars in 1248 bytes} [Fri Oct 28 19:13:54 2022] GET /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:54.805791 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-77c91408-6f7b-4932-b365-2a885d1be345 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:54.806308 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-77c91408-6f7b-4932-b365-2a885d1be345 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:54.812500 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-77c91408-6f7b-4932-b365-2a885d1be345 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:54.812986 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-77c91408-6f7b-4932-b365-2a885d1be345 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:54.814079 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-77c91408-6f7b-4932-b365-2a885d1be345 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:54.815085 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-77c91408-6f7b-4932-b365-2a885d1be345 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:54.815546 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-77c91408-6f7b-4932-b365-2a885d1be345 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:54.815973 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-77c91408-6f7b-4932-b365-2a885d1be345 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:54.951607 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-77c91408-6f7b-4932-b365-2a885d1be345 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:54.959941 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-77c91408-6f7b-4932-b365-2a885d1be345 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1572 microversion: 2.1 time: 0.158113 Oct 28 19:13:54.960520 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 456/883] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:54 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:55.567647 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-c4785d5f-b702-4982-a90e-ea9935396b3e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c816bca-b65b-4a53-802d-fe54994d0af2"}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:55.570302 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-c4785d5f-b702-4982-a90e-ea9935396b3e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 34677de8-0cd9-4298-9c60-4134aa2bff56] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:55.576913 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c4785d5f-b702-4982-a90e-ea9935396b3e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:55.577396 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c4785d5f-b702-4982-a90e-ea9935396b3e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:55.577832 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c4785d5f-b702-4982-a90e-ea9935396b3e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:55.578771 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c4785d5f-b702-4982-a90e-ea9935396b3e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:55.579775 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c4785d5f-b702-4982-a90e-ea9935396b3e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:55.580771 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-c4785d5f-b702-4982-a90e-ea9935396b3e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:55.983108 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-1baf4415-f1bd-418c-a534-59d53e070243 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:55.983662 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-1baf4415-f1bd-418c-a534-59d53e070243 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:55.989850 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1baf4415-f1bd-418c-a534-59d53e070243 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:55.990330 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1baf4415-f1bd-418c-a534-59d53e070243 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:55.990767 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1baf4415-f1bd-418c-a534-59d53e070243 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:55.991486 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1baf4415-f1bd-418c-a534-59d53e070243 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:55.991946 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1baf4415-f1bd-418c-a534-59d53e070243 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:55.992373 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-1baf4415-f1bd-418c-a534-59d53e070243 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:56.129523 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-1baf4415-f1bd-418c-a534-59d53e070243 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:56.137621 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-1baf4415-f1bd-418c-a534-59d53e070243 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1572 microversion: 2.1 time: 0.158515 Oct 28 19:13:56.138203 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 457/884] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:55 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1572 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:13:56.536353 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-c4785d5f-b702-4982-a90e-ea9935396b3e tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "POST /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.972442 Oct 28 19:13:56.537019 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 428/885] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Oct 28 19:13:55 2022] POST /compute/v2.1/servers/34677de8-0cd9-4298-9c60-4134aa2bff56/os-volume_attachments => generated 194 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:57.161181 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-0ce00b22-fa05-45c6-95c1-9d68e0bf2b8d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:57.161925 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-0ce00b22-fa05-45c6-95c1-9d68e0bf2b8d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:57.172691 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0ce00b22-fa05-45c6-95c1-9d68e0bf2b8d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:57.173893 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0ce00b22-fa05-45c6-95c1-9d68e0bf2b8d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:57.174755 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0ce00b22-fa05-45c6-95c1-9d68e0bf2b8d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:57.176172 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0ce00b22-fa05-45c6-95c1-9d68e0bf2b8d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:57.177302 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0ce00b22-fa05-45c6-95c1-9d68e0bf2b8d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:57.178126 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-0ce00b22-fa05-45c6-95c1-9d68e0bf2b8d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:57.361922 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-0ce00b22-fa05-45c6-95c1-9d68e0bf2b8d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:57.370009 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-0ce00b22-fa05-45c6-95c1-9d68e0bf2b8d tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1572 microversion: 2.1 time: 0.212913 Oct 28 19:13:57.370592 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 458/886] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:57 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1572 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:58.404419 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-2f987dfe-6a9e-4a44-b988-322764e993b1 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:58.405346 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-2f987dfe-6a9e-4a44-b988-322764e993b1 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] [instance: 429f9d21-c184-4baa-b7ea-bd94656890f3] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:58.412945 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2f987dfe-6a9e-4a44-b988-322764e993b1 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:58.413535 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2f987dfe-6a9e-4a44-b988-322764e993b1 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:58.414042 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2f987dfe-6a9e-4a44-b988-322764e993b1 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:58.414871 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2f987dfe-6a9e-4a44-b988-322764e993b1 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:58.415419 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2f987dfe-6a9e-4a44-b988-322764e993b1 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:58.415979 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-2f987dfe-6a9e-4a44-b988-322764e993b1 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:58.561376 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-2f987dfe-6a9e-4a44-b988-322764e993b1 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a47b7a9284cc8b44c8c732e5b6647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e5356491f54ddeb10f71d5c927e753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:58.570247 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-2f987dfe-6a9e-4a44-b988-322764e993b1 tempest-TestShelveInstance-1867458044 tempest-TestShelveInstance-1867458044-project] 10.222.0.58 "GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3" status: 200 len: 1559 microversion: 2.1 time: 0.170453 Oct 28 19:13:58.570848 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 429/887] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:58 2022] GET /compute/v2.1/servers/429f9d21-c184-4baa-b7ea-bd94656890f3 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:00.746523 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [req-eb67432f-c9bc-4e8a-9aa2-adb8fb66e00b req-c8ea4b44-d723-468e-88e8-effbde33aeb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "429f9d21-c184-4baa-b7ea-bd94656890f3", "name": "network-vif-plugged", "status": "completed", "tag": "47bb3174-db66-4aef-9eaa-fa1018a14bec"}]} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:00.761810 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-eb67432f-c9bc-4e8a-9aa2-adb8fb66e00b req-c8ea4b44-d723-468e-88e8-effbde33aeb7 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:00.763056 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-eb67432f-c9bc-4e8a-9aa2-adb8fb66e00b req-c8ea4b44-d723-468e-88e8-effbde33aeb7 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:00.763223 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [req-eb67432f-c9bc-4e8a-9aa2-adb8fb66e00b req-c8ea4b44-d723-468e-88e8-effbde33aeb7 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:00.779509 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.compute.server_external_events [req-eb67432f-c9bc-4e8a-9aa2-adb8fb66e00b req-c8ea4b44-d723-468e-88e8-effbde33aeb7 service nova] Creating event network-vif-plugged:47bb3174-db66-4aef-9eaa-fa1018a14bec for instance 429f9d21-c184-4baa-b7ea-bd94656890f3 on hv-cinder-86236 Oct 28 19:14:00.786198 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [req-eb67432f-c9bc-4e8a-9aa2-adb8fb66e00b req-c8ea4b44-d723-468e-88e8-effbde33aeb7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044044 Oct 28 19:14:00.786820 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 459/888] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:04.151822 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-cf894cb3-fb99-4844-80c4-0fcbd866ac59 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Action: 'create', calling method: .version_select at 0x7f9bf66bf9d0>, body: {"keypair": {"name": "tempest-keypair-957668208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEewJOUcQn9je62d3LpNIJ7w5ODmDE2O/LvQv7arGNOyObDTBHYjbKoAKTDdy6I4UtcKSPQf0FR/+9gRBnFcG69rhhq8UkNw/f00VrNyNAvu9Qk7eg7VRlq1i8go+dAfhQ=="}} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:04.158463 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:04.171432 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-cf894cb3-fb99-4844-80c4-0fcbd866ac59 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Getting quotas for project 7ac6ccae08d64b5e97805897acdb9aa4. Resources: {'key_pairs'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:14:04.177008 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.quota [None req-cf894cb3-fb99-4844-80c4-0fcbd866ac59 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Getting quotas for user f7c55684a73c4fd49a629012f2d4d661 and project 7ac6ccae08d64b5e97805897acdb9aa4. Resources: {'key_pairs'} {{(pid=118875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:14:04.207541 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-cf894cb3-fb99-4844-80c4-0fcbd866ac59 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059665 Oct 28 19:14:04.208370 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 430/889] 10.222.0.58 () {60 vars in 1159 bytes} [Fri Oct 28 19:14:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:05.868358 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-f0ac1822-ed9d-4fc6-87e8-b0fb945022b5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1349336864", "imageRef": "cd92a575-ed0d-417b-b416-3471be3ba100", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac9f8668-4631-4b96-94e3-b9995a5420ce"}], "security_groups": [{"name": "tempest-securitygroup--472567759"}], "key_name": "tempest-keypair-957668208", "user_data": "}} {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:05.877769 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_api:SELECT=31 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:05.980938 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.network.neutron [None req-f0ac1822-ed9d-4fc6-87e8-b0fb945022b5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] validate_networks() for [('ac9f8668-4631-4b96-94e3-b9995a5420ce', None, None, None, None, None)] {{(pid=118874) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:14:06.477842 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-f0ac1822-ed9d-4fc6-87e8-b0fb945022b5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Flavor limits 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:14:06.478597 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-f0ac1822-ed9d-4fc6-87e8-b0fb945022b5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Image limits 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:14:06.479537 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-f0ac1822-ed9d-4fc6-87e8-b0fb945022b5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Flavor pref 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:14:06.480291 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-f0ac1822-ed9d-4fc6-87e8-b0fb945022b5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Image pref 0:0:0 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:14:06.481048 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.virt.hardware [None req-f0ac1822-ed9d-4fc6-87e8-b0fb945022b5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:14:06.500357 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f0ac1822-ed9d-4fc6-87e8-b0fb945022b5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:06.501457 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f0ac1822-ed9d-4fc6-87e8-b0fb945022b5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:06.502237 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f0ac1822-ed9d-4fc6-87e8-b0fb945022b5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:06.503541 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f0ac1822-ed9d-4fc6-87e8-b0fb945022b5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:06.504586 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f0ac1822-ed9d-4fc6-87e8-b0fb945022b5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:06.505330 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-f0ac1822-ed9d-4fc6-87e8-b0fb945022b5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:06.521164 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:06.541294 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-f0ac1822-ed9d-4fc6-87e8-b0fb945022b5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Getting quotas for project 7ac6ccae08d64b5e97805897acdb9aa4. Resources: {'ram', 'instances', 'cores'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:14:06.549140 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.quota [None req-f0ac1822-ed9d-4fc6-87e8-b0fb945022b5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Getting quotas for user f7c55684a73c4fd49a629012f2d4d661 and project 7ac6ccae08d64b5e97805897acdb9aa4. Resources: {'ram', 'instances', 'cores'} {{(pid=118874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:14:06.567184 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f0ac1822-ed9d-4fc6-87e8-b0fb945022b5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Going to run 1 instances... {{(pid=118874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:14:06.571583 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-f0ac1822-ed9d-4fc6-87e8-b0fb945022b5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 1bc306c3-7ea7-4235-a24d-ac0ce05326aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd92a575-ed0d-417b-b416-3471be3ba100',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:14:06.627074 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-f0ac1822-ed9d-4fc6-87e8-b0fb945022b5 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.763399 Oct 28 19:14:06.627664 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 460/890] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Oct 28 19:14:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:14:06.639963 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-972a22c4-d4d4-44c9-b084-58e411e4904d tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:06.640581 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-972a22c4-d4d4-44c9-b084-58e411e4904d tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 1bc306c3-7ea7-4235-a24d-ac0ce05326aa] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:06.694892 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-972a22c4-d4d4-44c9-b084-58e411e4904d tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:06.706392 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-972a22c4-d4d4-44c9-b084-58e411e4904d tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa" status: 200 len: 1241 microversion: 2.1 time: 0.071315 Oct 28 19:14:06.706953 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 431/891] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:06 2022] GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:07.739590 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-fdf6dee4-4854-47b5-9f96-229167f8fe84 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:07.740157 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-fdf6dee4-4854-47b5-9f96-229167f8fe84 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 1bc306c3-7ea7-4235-a24d-ac0ce05326aa] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:07.753024 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fdf6dee4-4854-47b5-9f96-229167f8fe84 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:07.753649 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fdf6dee4-4854-47b5-9f96-229167f8fe84 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:07.754119 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fdf6dee4-4854-47b5-9f96-229167f8fe84 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:07.754851 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fdf6dee4-4854-47b5-9f96-229167f8fe84 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:07.755396 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fdf6dee4-4854-47b5-9f96-229167f8fe84 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:07.755930 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fdf6dee4-4854-47b5-9f96-229167f8fe84 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:07.843400 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-fdf6dee4-4854-47b5-9f96-229167f8fe84 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:07.851553 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-fdf6dee4-4854-47b5-9f96-229167f8fe84 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa" status: 200 len: 1301 microversion: 2.1 time: 0.118197 Oct 28 19:14:07.852452 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 461/892] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:07 2022] GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa => generated 1301 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:08.874864 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-0f4287aa-66bf-4d6f-8d7d-a335b77d82eb tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:08.875493 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-0f4287aa-66bf-4d6f-8d7d-a335b77d82eb tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 1bc306c3-7ea7-4235-a24d-ac0ce05326aa] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:08.877880 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:08.883630 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0f4287aa-66bf-4d6f-8d7d-a335b77d82eb tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:08.884110 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0f4287aa-66bf-4d6f-8d7d-a335b77d82eb tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:08.884545 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0f4287aa-66bf-4d6f-8d7d-a335b77d82eb tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:08.885242 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0f4287aa-66bf-4d6f-8d7d-a335b77d82eb tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:08.885691 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0f4287aa-66bf-4d6f-8d7d-a335b77d82eb tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:08.886114 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-0f4287aa-66bf-4d6f-8d7d-a335b77d82eb tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:08.952624 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-0f4287aa-66bf-4d6f-8d7d-a335b77d82eb tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:08.960913 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-0f4287aa-66bf-4d6f-8d7d-a335b77d82eb tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa" status: 200 len: 1299 microversion: 2.1 time: 0.090009 Oct 28 19:14:08.961474 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 432/893] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:08 2022] GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:09.983990 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-20a24707-53ac-49d2-9f4f-a126ee15e6b2 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:09.984590 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-20a24707-53ac-49d2-9f4f-a126ee15e6b2 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 1bc306c3-7ea7-4235-a24d-ac0ce05326aa] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:09.991125 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-20a24707-53ac-49d2-9f4f-a126ee15e6b2 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:09.991602 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-20a24707-53ac-49d2-9f4f-a126ee15e6b2 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:09.992275 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-20a24707-53ac-49d2-9f4f-a126ee15e6b2 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:09.992970 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-20a24707-53ac-49d2-9f4f-a126ee15e6b2 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:09.993414 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-20a24707-53ac-49d2-9f4f-a126ee15e6b2 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:09.993833 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-20a24707-53ac-49d2-9f4f-a126ee15e6b2 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:10.055977 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-20a24707-53ac-49d2-9f4f-a126ee15e6b2 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:10.063569 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-20a24707-53ac-49d2-9f4f-a126ee15e6b2 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa" status: 200 len: 1299 microversion: 2.1 time: 0.083488 Oct 28 19:14:10.064125 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 462/894] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:09 2022] GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:11.087129 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d2bce4c9-2f56-42a2-a5c0-b74811bd42cd tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:11.088759 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d2bce4c9-2f56-42a2-a5c0-b74811bd42cd tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 1bc306c3-7ea7-4235-a24d-ac0ce05326aa] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:11.097397 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d2bce4c9-2f56-42a2-a5c0-b74811bd42cd tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:11.097963 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d2bce4c9-2f56-42a2-a5c0-b74811bd42cd tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:11.098657 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d2bce4c9-2f56-42a2-a5c0-b74811bd42cd tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:11.099766 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d2bce4c9-2f56-42a2-a5c0-b74811bd42cd tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:11.100228 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d2bce4c9-2f56-42a2-a5c0-b74811bd42cd tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:11.100879 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d2bce4c9-2f56-42a2-a5c0-b74811bd42cd tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:11.179997 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d2bce4c9-2f56-42a2-a5c0-b74811bd42cd tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:11.188927 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d2bce4c9-2f56-42a2-a5c0-b74811bd42cd tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa" status: 200 len: 1299 microversion: 2.1 time: 0.106834 Oct 28 19:14:11.189821 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 433/895] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:11 2022] GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:12.212939 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-5ec112aa-f356-4749-a6cc-2abc1698cf38 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:12.213536 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-5ec112aa-f356-4749-a6cc-2abc1698cf38 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 1bc306c3-7ea7-4235-a24d-ac0ce05326aa] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:12.220465 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5ec112aa-f356-4749-a6cc-2abc1698cf38 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:12.220951 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5ec112aa-f356-4749-a6cc-2abc1698cf38 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:12.221382 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5ec112aa-f356-4749-a6cc-2abc1698cf38 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:12.222078 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5ec112aa-f356-4749-a6cc-2abc1698cf38 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:12.222523 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5ec112aa-f356-4749-a6cc-2abc1698cf38 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:12.222940 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-5ec112aa-f356-4749-a6cc-2abc1698cf38 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:12.369025 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-91bf915e-af8f-4a36-adea-bac6c6b3a712 req-d9ceb5e2-2de0-497c-a6d6-6166ae69bc47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc306c3-7ea7-4235-a24d-ac0ce05326aa", "tag": "d1ca3776-046e-461e-9b2f-0904c2e9ac00"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:12.378133 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-5ec112aa-f356-4749-a6cc-2abc1698cf38 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:12.381190 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-91bf915e-af8f-4a36-adea-bac6c6b3a712 req-d9ceb5e2-2de0-497c-a6d6-6166ae69bc47 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:12.382245 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-91bf915e-af8f-4a36-adea-bac6c6b3a712 req-d9ceb5e2-2de0-497c-a6d6-6166ae69bc47 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:12.382688 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-91bf915e-af8f-4a36-adea-bac6c6b3a712 req-d9ceb5e2-2de0-497c-a6d6-6166ae69bc47 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:12.387164 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-5ec112aa-f356-4749-a6cc-2abc1698cf38 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa" status: 200 len: 1366 microversion: 2.1 time: 0.178136 Oct 28 19:14:12.391024 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 463/896] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:12 2022] GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:12.394796 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-91bf915e-af8f-4a36-adea-bac6c6b3a712 req-d9ceb5e2-2de0-497c-a6d6-6166ae69bc47 service nova] Creating event network-changed:d1ca3776-046e-461e-9b2f-0904c2e9ac00 for instance 1bc306c3-7ea7-4235-a24d-ac0ce05326aa on hv-cinder-86236 Oct 28 19:14:12.405420 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-91bf915e-af8f-4a36-adea-bac6c6b3a712 req-d9ceb5e2-2de0-497c-a6d6-6166ae69bc47 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042394 Oct 28 19:14:12.406144 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 434/897] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:13.410771 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-23925799-674b-4886-b3bd-ba7f1330af52 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:13.411452 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-23925799-674b-4886-b3bd-ba7f1330af52 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 1bc306c3-7ea7-4235-a24d-ac0ce05326aa] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:13.419161 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-23925799-674b-4886-b3bd-ba7f1330af52 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:13.419710 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-23925799-674b-4886-b3bd-ba7f1330af52 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:13.420150 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-23925799-674b-4886-b3bd-ba7f1330af52 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:13.420853 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-23925799-674b-4886-b3bd-ba7f1330af52 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:13.421342 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-23925799-674b-4886-b3bd-ba7f1330af52 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:13.421766 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-23925799-674b-4886-b3bd-ba7f1330af52 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:13.575209 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-23925799-674b-4886-b3bd-ba7f1330af52 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:13.584685 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-23925799-674b-4886-b3bd-ba7f1330af52 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa" status: 200 len: 1366 microversion: 2.1 time: 0.177872 Oct 28 19:14:13.585268 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 464/898] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:13 2022] GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:14.608591 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-fab9b643-2316-45df-b343-453a8326e45a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:14.609290 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-fab9b643-2316-45df-b343-453a8326e45a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 1bc306c3-7ea7-4235-a24d-ac0ce05326aa] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:14.616008 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fab9b643-2316-45df-b343-453a8326e45a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:14.616504 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fab9b643-2316-45df-b343-453a8326e45a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:14.616946 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fab9b643-2316-45df-b343-453a8326e45a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:14.617676 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fab9b643-2316-45df-b343-453a8326e45a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:14.618131 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fab9b643-2316-45df-b343-453a8326e45a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:14.618564 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-fab9b643-2316-45df-b343-453a8326e45a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:14.765276 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-fab9b643-2316-45df-b343-453a8326e45a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:14.774587 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-fab9b643-2316-45df-b343-453a8326e45a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa" status: 200 len: 1366 microversion: 2.1 time: 0.170826 Oct 28 19:14:14.775223 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 435/899] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:14 2022] GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:15.797593 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-b4b14b44-b87e-4836-80d3-e501d42d42d0 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:15.798206 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-b4b14b44-b87e-4836-80d3-e501d42d42d0 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 1bc306c3-7ea7-4235-a24d-ac0ce05326aa] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:15.804223 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b4b14b44-b87e-4836-80d3-e501d42d42d0 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:15.804706 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b4b14b44-b87e-4836-80d3-e501d42d42d0 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:15.805144 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b4b14b44-b87e-4836-80d3-e501d42d42d0 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:15.805832 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b4b14b44-b87e-4836-80d3-e501d42d42d0 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:15.806362 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b4b14b44-b87e-4836-80d3-e501d42d42d0 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:15.806708 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-b4b14b44-b87e-4836-80d3-e501d42d42d0 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:15.937099 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-b4b14b44-b87e-4836-80d3-e501d42d42d0 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:15.944788 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-b4b14b44-b87e-4836-80d3-e501d42d42d0 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa" status: 200 len: 1366 microversion: 2.1 time: 0.151191 Oct 28 19:14:15.945355 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 465/900] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:15 2022] GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:16.969405 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-d703c68a-fcaf-4ba5-98d0-8821a1eccd29 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:16.971695 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-d703c68a-fcaf-4ba5-98d0-8821a1eccd29 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 1bc306c3-7ea7-4235-a24d-ac0ce05326aa] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:16.975773 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG dbcounter [-] [118875] Writing DB stats nova_cell0:SELECT=6 {{(pid=118875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:16.982088 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d703c68a-fcaf-4ba5-98d0-8821a1eccd29 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:16.983073 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d703c68a-fcaf-4ba5-98d0-8821a1eccd29 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:16.983771 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d703c68a-fcaf-4ba5-98d0-8821a1eccd29 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:16.984623 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d703c68a-fcaf-4ba5-98d0-8821a1eccd29 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:16.985181 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d703c68a-fcaf-4ba5-98d0-8821a1eccd29 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:16.985735 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-d703c68a-fcaf-4ba5-98d0-8821a1eccd29 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:17.134246 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-d703c68a-fcaf-4ba5-98d0-8821a1eccd29 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:17.141798 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-d703c68a-fcaf-4ba5-98d0-8821a1eccd29 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa" status: 200 len: 1366 microversion: 2.1 time: 0.177510 Oct 28 19:14:17.142392 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 436/901] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:16 2022] GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:18.165165 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-d7822b6d-d94c-4347-b67d-bcdb82e1f804 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:18.166107 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-d7822b6d-d94c-4347-b67d-bcdb82e1f804 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 1bc306c3-7ea7-4235-a24d-ac0ce05326aa] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:18.167773 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=2 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:18.168620 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG dbcounter [-] [118874] Writing DB stats nova_cell0:SELECT=6 {{(pid=118874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:18.175644 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d7822b6d-d94c-4347-b67d-bcdb82e1f804 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.176156 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d7822b6d-d94c-4347-b67d-bcdb82e1f804 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.176568 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d7822b6d-d94c-4347-b67d-bcdb82e1f804 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.177507 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d7822b6d-d94c-4347-b67d-bcdb82e1f804 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.177963 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d7822b6d-d94c-4347-b67d-bcdb82e1f804 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.178775 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-d7822b6d-d94c-4347-b67d-bcdb82e1f804 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.323895 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-d7822b6d-d94c-4347-b67d-bcdb82e1f804 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:18.332535 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-d7822b6d-d94c-4347-b67d-bcdb82e1f804 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa" status: 200 len: 1366 microversion: 2.1 time: 0.171756 Oct 28 19:14:18.333107 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 466/902] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:18 2022] GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:18.841152 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-b0048f92-574c-403b-99b1-207e184c3cc4 req-57ff7980-fdba-4d7b-85bd-b1fc8ff5a43e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc306c3-7ea7-4235-a24d-ac0ce05326aa", "name": "network-vif-plugged", "status": "completed", "tag": "d1ca3776-046e-461e-9b2f-0904c2e9ac00"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:18.852152 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-b0048f92-574c-403b-99b1-207e184c3cc4 req-57ff7980-fdba-4d7b-85bd-b1fc8ff5a43e service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.852691 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-b0048f92-574c-403b-99b1-207e184c3cc4 req-57ff7980-fdba-4d7b-85bd-b1fc8ff5a43e service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.853135 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-b0048f92-574c-403b-99b1-207e184c3cc4 req-57ff7980-fdba-4d7b-85bd-b1fc8ff5a43e service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.865564 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-b0048f92-574c-403b-99b1-207e184c3cc4 req-57ff7980-fdba-4d7b-85bd-b1fc8ff5a43e service nova] Creating event network-vif-plugged:d1ca3776-046e-461e-9b2f-0904c2e9ac00 for instance 1bc306c3-7ea7-4235-a24d-ac0ce05326aa on hv-cinder-86236 Oct 28 19:14:18.870509 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-b0048f92-574c-403b-99b1-207e184c3cc4 req-57ff7980-fdba-4d7b-85bd-b1fc8ff5a43e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033061 Oct 28 19:14:18.871317 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 437/903] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:14:19.355723 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-fc28ba90-c9be-4451-b309-8c4c73739986 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:19.356274 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-fc28ba90-c9be-4451-b309-8c4c73739986 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 1bc306c3-7ea7-4235-a24d-ac0ce05326aa] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:19.362313 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fc28ba90-c9be-4451-b309-8c4c73739986 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:19.362791 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fc28ba90-c9be-4451-b309-8c4c73739986 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:19.363261 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fc28ba90-c9be-4451-b309-8c4c73739986 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:19.363955 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fc28ba90-c9be-4451-b309-8c4c73739986 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:19.364407 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fc28ba90-c9be-4451-b309-8c4c73739986 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:19.364828 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-fc28ba90-c9be-4451-b309-8c4c73739986 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:19.500546 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.policy [None req-fc28ba90-c9be-4451-b309-8c4c73739986 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118874) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:19.511778 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-fc28ba90-c9be-4451-b309-8c4c73739986 tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa" status: 200 len: 1366 microversion: 2.1 time: 0.156778 Oct 28 19:14:19.511778 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 467/904] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:19 2022] GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:20.534337 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [None req-056d24b3-3b24-452f-bb45-efd703d014ed tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:20.535158 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.compute.api [None req-056d24b3-3b24-452f-bb45-efd703d014ed tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 1bc306c3-7ea7-4235-a24d-ac0ce05326aa] Fetching instance by UUID {{(pid=118875) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:20.541730 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-056d24b3-3b24-452f-bb45-efd703d014ed tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:20.542218 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-056d24b3-3b24-452f-bb45-efd703d014ed tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:20.542657 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-056d24b3-3b24-452f-bb45-efd703d014ed tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:20.543386 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-056d24b3-3b24-452f-bb45-efd703d014ed tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:20.543841 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-056d24b3-3b24-452f-bb45-efd703d014ed tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:20.544267 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [None req-056d24b3-3b24-452f-bb45-efd703d014ed tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:20.698748 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.policy [None req-056d24b3-3b24-452f-bb45-efd703d014ed tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c55684a73c4fd49a629012f2d4d661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6ccae08d64b5e97805897acdb9aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118875) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:20.707702 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [None req-056d24b3-3b24-452f-bb45-efd703d014ed tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa" status: 200 len: 1556 microversion: 2.1 time: 0.178733 Oct 28 19:14:20.708398 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 438/905] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:20 2022] GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:20.733345 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.api.openstack.wsgi [None req-cb166ae9-2e9c-4ee5-ab6c-33fef7c9dd3a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Calling method '>' {{(pid=118874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:20.733873 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG nova.compute.api [None req-cb166ae9-2e9c-4ee5-ab6c-33fef7c9dd3a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] [instance: 1bc306c3-7ea7-4235-a24d-ac0ce05326aa] Fetching instance by UUID {{(pid=118874) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:20.741139 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cb166ae9-2e9c-4ee5-ab6c-33fef7c9dd3a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:20.741637 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cb166ae9-2e9c-4ee5-ab6c-33fef7c9dd3a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:20.742174 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cb166ae9-2e9c-4ee5-ab6c-33fef7c9dd3a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:20.743072 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cb166ae9-2e9c-4ee5-ab6c-33fef7c9dd3a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:20.743500 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cb166ae9-2e9c-4ee5-ab6c-33fef7c9dd3a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:20.743924 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: DEBUG oslo_concurrency.lockutils [None req-cb166ae9-2e9c-4ee5-ab6c-33fef7c9dd3a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:20.828957 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: INFO nova.api.openstack.requestlog [None req-cb166ae9-2e9c-4ee5-ab6c-33fef7c9dd3a tempest-AttachVolumeNegativeTest-1220951056 tempest-AttachVolumeNegativeTest-1220951056-project] 10.222.0.58 "GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100706 Oct 28 19:14:20.830206 dv-cinder-862365-1-iscsi devstack@n-api.service[118874]: [pid: 118874|app: 0|req: 468/906] 10.222.0.58 () {58 vars in 1275 bytes} [Fri Oct 28 19:14:20 2022] GET /compute/v2.1/servers/1bc306c3-7ea7-4235-a24d-ac0ce05326aa/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:14:21.850031 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG nova.api.openstack.wsgi [req-fbac9e56-70dd-49f6-b489-b46a9bb6f777 req-4b6a05f6-0a8c-4505-8a65-88d4d4eb4671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc306c3-7ea7-4235-a24d-ac0ce05326aa", "tag": "d1ca3776-046e-461e-9b2f-0904c2e9ac00"}]} {{(pid=118875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:21.860141 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-fbac9e56-70dd-49f6-b489-b46a9bb6f777 req-4b6a05f6-0a8c-4505-8a65-88d4d4eb4671 service nova] Acquiring lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:21.861436 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-fbac9e56-70dd-49f6-b489-b46a9bb6f777 req-4b6a05f6-0a8c-4505-8a65-88d4d4eb4671 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:21.861944 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: DEBUG oslo_concurrency.lockutils [req-fbac9e56-70dd-49f6-b489-b46a9bb6f777 req-4b6a05f6-0a8c-4505-8a65-88d4d4eb4671 service nova] Lock "5dcc3b4c-f46d-4789-b42a-a872c650e37f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:21.874300 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.compute.server_external_events [req-fbac9e56-70dd-49f6-b489-b46a9bb6f777 req-4b6a05f6-0a8c-4505-8a65-88d4d4eb4671 service nova] Creating event network-changed:d1ca3776-046e-461e-9b2f-0904c2e9ac00 for instance 1bc306c3-7ea7-4235-a24d-ac0ce05326aa on hv-cinder-86236 Oct 28 19:14:21.879663 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: INFO nova.api.openstack.requestlog [req-fbac9e56-70dd-49f6-b489-b46a9bb6f777 req-4b6a05f6-0a8c-4505-8a65-88d4d4eb4671 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033405 Oct 28 19:14:21.880392 dv-cinder-862365-1-iscsi devstack@n-api.service[118875]: [pid: 118875|app: 0|req: 439/907] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0)